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Abstract  of  Dissertation  presented  to  the  Graduate  School 
of  the  University  of  Florida  in  Partial  Fulfillment  of  the 
Requirements  for  the  Degree  of  Doctor  of  Philosophy 

REALIZATION  OF  LINEAR  DISCRETE 
TIME-VARYING  SYSTEMS 

By 

Jose  J.  Ferrer  Suarez 
December  1984 

Chairman:  Edward  W.  Kamen 

Major  Department:  Electrical  Engineering 

This  work  is  concerned  with  the  construction  of  linear,  discrete, 
time-varying,  finite-dimensional  state-variable  models  (a  realization) 
from  input/output  data  of  discrete  dynamical  systems.  The  input/output 
data  are  represented  by  a linear  map  fw  with  a pxm  matrix  W(k,  1)  as  its 
unit-pulse  response.  Local  and  global  conditions  for  realizability  are 
given  in  terms  of  the  notion  of  the  generalized  Hankel  matrix.  An 
algorithm  to  construct  a canonical  realization,  where  it  is  possible  for 
one  to  exist,  is  developed.  In  the  last  part  of  this  work,  the 
realization  algorithm  is  applied  to  the  problem  of  system  reduction. 
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CHAPTER  ONE 
INTRODUCTION 

A discrete  time-varying  dynamical  system  is  usually  described  in 
two  ways:  by  a state-space  description,  and  by  an  input/output  (i/o) 

description.  The  state  description  is  generally  used  when  one  is 
interested  in  the  internal  behavior  of  a system  and  it  consists  of  a 
first-order  vector  difference  equation  x(k+l)  = F(k)x(k)  + G(k)u(k),  and 
an  output  equation  y(k)  = H(k)x(k)  where  x(k)  is  the  state,  u(k)  is  the 

input,  and  y(k)  is  the  output.  On  the  other  hand,  the  i/o  description 

arises  naturally  when  one  considers  the  system's  external  behavior, and 
it  is  defined  here  by  a linear  input/output  map  whose  "kernel"  or  "unit- 
pulse  response  function"  is  a pxm  matrix  W ( k , 1 ) with  k > 1.  It  is  also 
possible  to  describe  a time-varying  dynamical  system  from  the 
input/output  point  of  view  by  its  "transfer  function"  (see  KAMEN  and 
KHARGONEKAR  [1982]  and  POOLLA  [1984]  for  details).  We  shall  not 

consider  in  this  work  the  transfer  function  approach.  The  state-space 
and  input/output  approaches,  far  from  being  mutually  exclusive,  are  both 
used  in  control  problems. 

The  translation  from  an  input/output  description  to  a state-space 
one  is  an  important  question.  In  particular,  the  problem  of  finding  a 
state  model  for  a given  system  described  by  its  i/o  map  is  called  the 
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problem  of  realization.  Exactly  how  one  does  this  in  the  case  of 
continuous  time-varying  system  has  been  the  subject  of  many  papers  in 
recent  years  (see  SILVERMAN  and  MEADOWS  [1966],  KALMAN  [1968b],  KAMEN 
[1979],  FLIESS  [1982,  1983]).  Surpri si ngly , t hi s question  has  received 
little  attention  in  the  case  of  discrete  time-varying  systems. 

It  turns  out  that  the  solution  of  the  problem  of  realization  in  the 
discrete-time  framework  is  much  more  than  a simple  carry-over  of  the 
correspondi ng  one  for  continuous-time  systems.  In  this  work,  we  shall 
see  that  there  exist  basic  differences  between  the  continuous-time  and 
the  discrete-time  frameworks.  Let  us  suppose  we  want  to  analyze  a "black 
box"  system  Z on  the  basis  of  input/output  experiments.  Then,  strictly 
speaking,  the  impulse  response  matrix  WE( t , t),  when  Z is  continuous, 
and  the  pulse-response  matrix  W^(k,  1),  when  Z is  discrete,  can  only  be 
determined  (or  measured)  over  the  causal  half  plane  (t  > x and  k > 1 
respectively).  In  the  continuous-time  case,  when  the  entries  of  W^, 
are  analytic  functions,  the  impulse  response  can  be  extended  uniquely  to 
the  region  t < t by  analytic  continuation  to  obtain  what  is  called  the 
"weighting  pattern"  matrix,  W^,  of  the  system.  For  a discrete-time 
system,  however,  there  is  no  unique  extension  of  WE(k,l)  to  the  region 
k < 1 due  to  the  discrete-time  nature  of  the  system.  Since  most  of  the 
existing  realizability  criteria  for  continuous  i/o  maps  are  based  on  the 
notion  of  the  weighting  pattern,  5J„,  one  should  not  expect  to  be  able 
to  carry  over  those  results  to  the  discrete-time  case. 

The  problem  of  realization  for  linear  discrete  time-varying  systems 
was  first  considered  by  WEISS  [1972]  and  EVANS  [1972]. 


The  former 
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author  gave  a realization  procedure  for  linear  input/output  maps  known 
to  have  canonical  realizations  (that  is,  state-space  models  which  are 
both  reachable  and  observable);  however,  he  did  not  give  realizability 
criteria  nor  did  he  determine  those  input/output  maps  which  have  a 
canonical  realization.  On  the  other  hand,  Evans  did  not  provide  a 
realization  scheme  even  though  he  derived  necessary  and  sufficient 
conditions  for  realizability.  Unfortunately,  Evans's  criteria  are  not 
easy  to  implement  from  the  computational  point  of  view. 

As  noted  above,  the  problem  of  realization  for  discrete  time- 
varying  input/output  maps  is  far  from  complete.  In  this  dissertation, 
the  discrete-time  realization  problem  is  approached  from  an  entirely 
different  angle  from  that  employed  by  Weiss  and  Evans  (though  some 
results  due  to  the  latter  author  are  used). 

The  major  contributions  of  this  project  are 

(i)  the  introduction  of  the  notion  of  representati ve  formal  power 
series  and  the  concept  of  the  (generalized)  Hankel  matrix  in 
the  study  of  realizability  of  linear  discrete  i/o  maps; 

(ii)  the  discovery  of  not  only  "local"  realizability  criteria  but 
also  of  "global"  ones  which  can  be  considered  as  the 
discrete-time  counterpart  of  those  obtained  by  KALMAN  [1968b] 
and  by  KAMEN  [1979]  respectively; 

(iii)  the  introduction  of  the  concept  of  response  maps  with  finite 
constant  rank,  the  importance  of  which  maps  is  shown  by  the 
fact  that  they  are  the  only  kind  for  which  there  exists  a 
canonical  realization; 
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(iv)  the  development  of  an  algorithm  to  find  canonical 
realizations. 

It  should  be  noted  that  the  results  obtained  in  this  project  relate 
only  to  the  noise-free  case. 

Chapter  Two  of  the  report  gives  a summary  of  realization  theory  for 
time-invariant  systems  and  for  continuous  time-varying  ones  in  order  to 
provide  the  reader  with  the  necessary  background  and  to  facilitate  the 
comparison  of  those  systems  with  the  discrete  time-varying  ones.  Here, 
the  problem  of  realization  in  the  discrete-time  framework  is  stated. 

In  Chapter  Three,  we  consider  a local  realizability  criterion  which 
is  obtained  through  the  theory  of  generalized  representative  formal 
power  series.  The  scalar  version  of  this  kind  of  series  was  used  for 
the  first  time  by  FLIESS  [1982,  1983]  in  his  work  on  realization  of  real 
analytic  time-varying  systems.  This  approach  to  the  realization  problem 
(in  the  discrete-time  framework)  is  believed  to  be  novel.  Furthermore, 
it  is  important  to  say  that  the  principal  result  of  this  section  is 
expressed  in  terms  of  the  Hankel  matrix,  and  it  can  be  considered  as  the 
discrete-time  counterpart  of  those  results  obtained  by  KALMAN  [1968], 
SILVERMAN  and  MEADOWS  [1966],  and  SILVERMAN  [1971]  for  continuous-time 
systems . 

In  Chapter  Four,  we  find  realizability  criteria  which  require  that 
the  unit  pulse  response  of  a given  i /o  map  satisfies  some  recursive 
relation.  These  conditions  are  the  discrete-time  version  of  the  ones 
developed  in  KAMEN  [1979]  for  real  analytic  time-varying  systems. 
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In  Chapter  Five,  we  determine  some  global  realizability  criteria 
based  on  the  concept  of  the  Hankel  matrix.  In  the  framework  developed 
here,  the  Hankel  matrix  is  defined  over  the  ring  B of  all  bi -infinite 
sequences  over  a fixed  field  K.  Realizability  criteria  are  given  in 
terms  of  the  finiteness  of  modules  over  B spanned  (or  generated)  by  the 
elementary  rows  or  columns  of  the  Hankel  matrix.  These  results  are 
similar  to  realizability  criteria  for  linear  real -analyti c time-varying 
systems  developed  by  KAMEN  [1979]. 

In  Chapter  Six  we  introduce  the  concept  of  linear  input/output  maps 
with  finite-constant  rank,  and  show  that  only  for  this  kind  of  response 
maps  it  is  possible  to  construct  realizations  which  are  both  reachable 
and  observable  (i.e.,  canonical).  Also,  it  is  seen  here  that  it  is  not 
true  that  the  realization  theory  for  discrete-time  systems  is  a simple 
carry  over  of  the  corresponding  one  for  continuous-time  systems.  In 
fact,  we  show  that  the  i/o  map  of  a constant  rank  system  does  not 
necessarily  have  finite  constant-rank  (for  continuous-time  systems  it  is 
true  though,  see  KAMEN  [1979]). 

In  Chapters  Seven  and  Eight,  the  construction  of  canonical 
(minimal)  realizations  for  response  maps  with  finite-constant  rank  is 
considered.  By  using  a method  for  computing  a basis  for  a finite  free 
module  defined  over  some  subrings  of  B,  we  develop  a realization 
procedure  for  computing  canonical  realizations.  This  algorithm  is  the 
discrete-time  counterpart  of  the  one  given  in  KAMEN  [1979]  for  real 
analytic  time-varying  systems,  and  it  is  a generalization  of  WEISS's 
algorithm. 
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In  Chapter  Eight,  we  also  solve  the  important  problem  of  getting  a 
canonical  realization,  if  one  exists,  from  a given  realization  E = (D, 
E,  H)  of  a linear  i/o  map  f E . 

In  Appendices  One  and  Two,  we  review  some  algebraic  results  which 
will  be  used  in  Chapters  Seven  and  Eight.  We  also  propose  a more 
general  version  of  the  problem  of  realization  studied  in  this 

dissertation.  Furthermore,  we  find  necessary  and  sufficient  conditions 
for  realizability  of  input/output  maps  defined  on  some  "proper"  subsets 
of  the  causal  half-plane. 


CHAPTER  TWO 

SYSTEM  DEFINITIONS  AND  REVIEW  OF  SOME  REALIZABILITY  RESULTS 

In  this  section,  some  basic  definitions  and  a summary  of 
realization  theory  of  linear  systems  will  be  given  in  order  to  help  the 
reader  to  understand  better  the  problem  to  be  solved  in  this  project. 

2.1  Time-invariant  systems 

For  any  fixed  field  K,  and  for  any  fixed  n e Z+  = set  of  all 
positive  integers,  let  us  denote  by  Kn  the  K-linear  space  consisting  of 
all  n-element  column  vectors  whose  entries  are  in  K. 

An  m-i nput  p-output  n-dimensional  time-invariant  system  £ over  K is 
a triple  £ : = (F,G,H)  of  nxn,  nxm,  pxm  matrices  over  K together  with  the 
following  dynamical  equations 

(ex) (t)  = F x(t)  + G u(t) ; 

(2.1.1) 

y(t)  = H x(t)  , t e T 

where  T = (ordered)  additive  subset  of  R (the  field  of  real  numbers), 
x(t)  e Kn  is  the  state  of  the  system  at  time  t,  u(t)  e Km  is  the  input 
or  control  law  at  time  t,  y(t)  e K?  is  the  output  at  time  t,  and  6 is  an 
operator  which  can  be  interpretated  as 
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(i) 

the  left  shift  operator,  i.e.,  (0x)(t)  = x(t+l);  in  this 

case,  T is  usually  taken  as  Z+  U{o),  and  E is  called  a 
discrete  time-invariant  system  with  state  equations 

(2.1.2) 

x(t  + 1)  = F x(t)  + G u(t) , 
y(t)  = H x ( t ) , 

(11) 

the  derivative  operator;  that  is  (0x)(t)  = x(t)  . Then, 
we  assume  that  K = R,  and  we  say  that  E is  a continuous  time- 
invariant  system  with  state  equations 

(2.1.3) 

x(t)  = F x(t)  + G u(t) , 
y(t)  = h x ( t ) . 

For  x(o)  = 

o,  the  solution  of  (2.1.2)  can  be  shown  to  be 

(2.1.4) 

y (t)  = l H Ft"£“1  G u(£),  for  all  t e Z+. 
£=0 

The  sequence  of  pxm  matrices  W:  = W^,  W?,  ...  , where  = H Fi_1  G, 

is  called  the  unit-pulse  response  sequence  of  E.  Furthermore,  from 

(2.1.4)  it  is  seen  that  the  input/output  behavior  of  the  system  E is 

completely  characteri zed  by  W.  In  fact,  it  is  well  known  that  any  map 

which  sends  sequences  (u(o),  u(l),  ...  } into  sequences  {y ( 1 ) , y(2), 

...}  and  which  satisfies  "linearity,"  "causality,"  and  "shift- 

invariance"  conditions,  is  determined  by  a matrix  sequence  {Wi , Wo,  ...} 

t-i  . 

and  is  defined  by  the  convolution  sum  y(t)  = I W u(£),  t e Z . 

£=0  t_ 
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On  the  other  hand,  for  continuous  time-invariant  systems  it  is 
well-known  (see  DESOER  [1970],  BROCKETT  [1970],  PADULO  and  ARBIB  [1974]) 
that  the  solution,  or  output  response,  of  (2.1.3)  to  a zero  initial 
state  x(tQ)  and  an  input  u(t)  on  T is  given  by 

t 

(2.1.5-a)  y(t)  = / W(t  - t)  u(t)  dt  t > t , t , t e T , 

t oo 

o 

where 

(2.1.5-b)  W(t)  = HeFt  G , t > t , 

is  the  so  called  impulse-response  matrix  associated  with  Z.  By 
expanding  the  right  side  of  (2.1.5-b)  into  a MacLaurin  series  (see  HO 
[1966]  for  details),  we  have  that  the  i/o  map  defined  by  (2.1.5-a)  is 
uniquely  determined  by  the  sequence  of  pxm  matrices  over  R,  where 

Wn-  = H Fi-1  G for  each  i e Z+. 

The  above  considerations  suggest  the  following  abstract  definition 
of  the  algebraic  realization  problem  for  time-invariant  systems  over  an 
arbitrary  field  K. 

(2.1.6)  DEFINITION:  A time-invariant  input/output  (i/o)  map  fw  i s a 
sequence  (Wj,  W?,  ...  } of_  pxm  matrices  over  K.  A system  £ = (F,G,H) 
realizes  fw  if  an  only  if  Wi  = H F1"1  G for  each  i e Z+.  A realization 
T.  = (F,G,H)  is  said  to  be  minimal  if  its  dimension  is  minimal  among  all 

possible  realizations  of  f^ 
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Denote  by  KPxm[[z"*]]  the  K-l inear  space  of  all  formal  power  series 
over  KPxm  in  the  indeterminate  z . That  is,  an  element  W in 

KPxm[[z“l]]  is  of  the  form 

oo 

(2.1.7)  W = l W.  z_1  , W.  e Kpxm 

i =1  1 1 

00 

(2.1.8)  DEFINITION:  A formal  power  series  W = £ W..  z-^  J_n 

Kpxm  [ [ z 1]]  is  said  to  be  recurrent  if  and  only  if  there  exist  a 

positive  integer  n and  elements  an,  ct-,,  ...,  an_-,  in  K such  that 

n-1 

Wn+k  = l a..  W.+^  for  all  non-negative  integers  k. 
i =o 

The  question  of  whether  or  not  a time-invariant  i/o  map  f^  = (W-^, 
W?,  ...  } has  a realization  is  answered  next. 

(2.1.9)  THEOREM.  (KALMAN,  FALB , and  ARBIB  [1969])  A time-invariant 

input/output  map  fw  is  realizable  if  and  only  if  the  formal  power  series 

(2.1.10)  W(z_1):  = l W z'1  e Kpxm[[z-1]]  , 

i =1  1 

is  recurrent  in  the  sense  of  definition  (2.1.8). 

Since  each  Wq-  is  a pxm  matrix  over  K,  the  formal  power  series 

associated  with  fy  (see  (2.1.10))  can  also  be  represented  as  a matrix 
(wi j (z_1) )pxm*  where  each  wij(z_1)  is  an  element  of  K[[z-1]].  A formal 

power  series  with  scalar  coefficients  is  said  to  be  rational  if  it  is 

the  expansion  in  z_1  of  a quotient  p(z)/q(z),  where  p(z),  q(z)  are 
polynomials  with  coefficients  in  K,  and  q(z)  is  a monic  polynomial  of 
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degree  greater  than  that  of  p(z).  An  arbitrary  formal  power  series 
W(z-1)  in  Kpxm[[z-1]]  is  rational  if  all  w^z-1)  are  rational. 

(2.1.10)  PROPOSITION:  A time-invariant  i/o  map  f^  = {W^,  W2,  ...  } i s 
realizable  if  and  only if  its  associated  power  series 

00 

W(z  1)  = l U.  z_i  is  rational, 
i =1  1 

For  a proof  of  the  above  see  EILENBERG  [1974]. 

In  order  to  give  more  explicit  criteria  to  decide  whether  a given 
fw  realizable,  we  formally  define  the  Hankel  or  behavior  matrix  of  an 
i/o  map  fw  as  the  bi-infinite  matrix  given  by,  in  block  form, 

wx  w 2 w3  . . . 

w2  . . . 

w3  w4  w5  . . . 

• • • 

• • • 

• • • 

The  rank  of  is  defined  as  the  smallest  positive  integer  n such  that 
all  minors  of  Bw  of  order  greater  than  n are  zero.  In  particular,  Bw 
has  infinite  rank  when  there  exist  non-zero  minors  of  arbitrary  order. 
A well-known  criterion  of  realizability  (see  Kalman  [1968-b])  is  given 
next . 

(2.1.12)  THEOREM:  A time -i  nvari  ant  i/o  map  fw  = (Wj , W2,  ...}  is 

realizable  if  and  only  if  B^  has  finite  rank  n.  Furthermore,  n is  the 
dimension  of  a minimal  realization. 


(2.1.11) 


BW  = 
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Next,  we  review  a realization  procedure  which  was  developed  in 

SILVERMAN  [1971]  and  for  which  an  abstract  i nterpretation  was  given  by 

ROUCHALEAU  [1972]  (see  also  KALMAN  [1976]). 

With  c^  denoting  the  ith  elementary  column  of  Bw,  let  X,^  be  the 

K-linear  space  consisting  of  all  finite  linear  combinations  Y a.c.  with 

1 1 1 

a.j  e K.  Then  the  condition  that  rank  By  = n is  equivalent  to  saying 
c 

that  X^  has  dimension  n.  Define  the  following  linear  map 


1 

X 
* — ' 

I 

Xl+p 

X 

ro 

X2+P 

x3 

• 

• 

x3+p 

• 

• 

• 

• 

By  definition,  4>p  acts  on  c-j  by  dropping  the  first  p-components  of  c-j . 
Now,  define 

m 

IT  : KiT1  ->•  xft  : u ->  l u.  c,  , u.  = i -entry  of  the  system  input  u 

1*1 

H : X^  -*■  K^:  x -*>  Hx  = first  p-components  of  x 

It  is  not  hard  to  show  that  the  system  E = (F,G,H),  where  F,G,H  are 
matrix  representati ons  of  4>p,  G,  and  H,  respectively,  is  a minimal 
realization  of  f,,. 

The  construction  of  the  above  realization  £ = (F,G,H)  was  defined 
in  terms  of  the  vector  space  X,^  . From  the  practical  point  of  view,  we 
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would  like  to  give  an  explicit  realization  procedure.  So,  we  shall 
briefly  review  a very  popular  algorithm  for  realization  of  i /o  maps. 

Again  let  By  denote  the  infinite  Hankel  matrix  defined  by 
(2.1.11).  The  condition  rank  By  = n is  equivalent  to  the  existence  of 
an  nxn  nonsingular  submatrix  4>  of  By.  Given  $,  let  r be  the  nxm 
submatrix  of  the  first  m elementary  columns  of  By  whose  rows  correspond 
to  those  of  $;  similarly,  let  A be  the  pxn  submatrix  of  the  first  p- 
elementary  rows  of  By  whose  columns  corrospond  to  those  of  $.  Finally, 
denote  by  the  nxn  submatrix  of  By  whose  rows  correspond  to  those  of  $ 
and  whose  ith  column  is  m-positions  to  the  right  of  the  ith  column  of 
$.  With  these  conventions,  we  have  the  following  result. 

(2.1.13)  THEOREM.  (SILVERMAN  [1971]).  Assume  that  the  time-invariant 
i/o  map  fy  = {Wj,  W2,  ...  } is  realizable,  i.e. , rank  By  = n,  and  let  $ 
be  an  nxn  non-singular  submatrix  of  By.  Then  (<t>-1  a<6,  $_1r,  A)  is  a 
minimal  realization  of  fy. 

An  n -dimensional  system  E = (F,G,H)  (£  may  represent  either  a 

discrete  or  a continuous  system)  is  said  to  be  reachable  if  the  nxnm 
reachability  matrix  R:  = [G,FG, . . . ,Fn-^G]  has  rank  n.  Also,  we  say  that 
E is  observable  if  the  npxn  observability  matrix  0T:  = [H^,  F^H^,  ... 
(Fn-1)THT]T  )1as  ran|<  n>  Furthermore,  E is  s aid  to  be  canonical  if  it  is 
reachable  and  observable. 

For  a realizable  time-invariant  i/o  map  fy  = {Wj,  W?,  ...}  we  have 
the  following  useful  result  due  to  KALMAN  [1976]. 
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(2.1.14)  PROPOSITION:  Lat  fw  = {W^,  W2,  ...  } be  a time-i n variant 

input/output  map,  and  let  Z = (F,G,H)  be  a finite-dimensional 
realization  of  f^.  Then  Z is  a minimal  realization  of  if  only  if  Z 
is  canonical . 


2.2  Analytic  Continuous-Time  Systems 
Let  tj,  tj  e R U{”}  such  that  t^  < t2»  Denote  by  A(J)  the  R-linear 
space  of  all  real -valued  analytic  functions  defined  on  J = (t^,  t2). 
With  pointwise  addition  and  multiplication,  A(J)  becomes  a commutative 
ring  with  unity  1:J  R:  t + 1.  In  fact,  it  follows  from  SILVERMAN  and 
BUCY  [1970],  see  also  KAMEN  [1979],  that  A(J)  is  a Bezout  domain;  that 
is,  A(J)  is  an  integral  domain  and  every  finitely  generated  ideal  in 
A( J)  is  pri nci pal  . 

For  any  fixed  positive  integers  m,n  and  p,  an  m-input  p-output 
n-dimensi onal  linear  time-varying  system  Z over  A(J)  is  a triple  Z = 
(F,G,H)  consisting  of  nxn,  nxm,  pxn  matrices  over  A(J),  together  with 
the  dynamical  equations. 

(2.2.1)  dX(t)  = F(t)  x(t)  + G(t)  u(t)  , 

(2.2.2)  y(t ) = H(t)  x(t)  , 

where  x(t)  eRn  is  the  state  at  time  t,  u(t)  e Rm  is  the  input  or  control 
at  time  t,  and  y(t)  eRP  is  the  system  output  at  time  t. 
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Let  Cm(J)  denote  the  K-l inear  space  of  all  m-element  column  vectors 
whose  components  are  continuous  real -valued  functions  defined  on  J. 
Then  as  is  well  known  (see  KALMAN  and  WEISS  [1965]  and  KALMAN  [1968-a]), 
the  complete  solution  of  (2.2.1)  for  an  initial  state  = x(t^)  and  for 
an  input  u eCm(J)  is  given  by 


t 

(2.2.3)  x(t)  = $(t,t,)x,  + / $(t , x)  G(t)  u(t)  dx,  t e J, 

11  t 

where  $(t,x)  is  the  state-transition  matrix  associated  with  F(t).  From 
(2.2.2)  and  (2.2.3),  it  follows  that  the  output  response  of  E due  to  an 
input  u eCm(J)  with  x-^  = o is  given  by 


(2.2.4) 


t 

y(t)  = / Wz  (t,x)u(x)  dx  , t e J , 


where  the  matrix 


(2.2.5) 


H(t ) $ (t , x)G( x) 


Wz  (t,x) 


0 , 


t > x , 
otherwi se. 


is  the  so-called  impulse-response  function  matrix.  It  is  easy  to  see 
from  (2.2.4)  that  the  impulse-response  matrix  completely  characterizes 
the  input/output  properties  of  £,  which  is  a causal  dynamical  system. 
For  many  problems  of  control  and  estimation  it  is  useful  to  define 
$(t,x)  for  x > t,  which  leads  to  the  notion  of  the  weighting  pattern 
matrix  defined  by 
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(2.2.6)  Wj.(t,T)  = H(t)$(t,x)G(x)  for  all  t,  t e J. 

Since  the  impulse  response  Wz  (t , t)  is  analytic,  it  can  be  extended 
uniquely  by  analytic  continuation  to  the  region  t > t.  Therefore,  for 
analytic  systems  (2.2.9),  the  impulse  response  and  the  weighting  pattern 
contain  the  same  information.  Since  W^t.x)  = (t,x)  for  all  t, 

x e J,  we  can  write 

t 

(2.2.7)  y (t ) = / W (t,x)  u(t)  dx,  t e J. 

h 

The  relation  (2.2.7)  defines  a map  f2:  Cm(J)  CP(J):  u > fE(u)  = y 

which  is  usually  referred  to  as  the  response  map  (or  input/output  map) 

of  the  system  E. 

For  fixed  positive  integers  p,  m,  let  W(t,x)  be  a pxm  matrix  whose 
entries  are  real -valued  analytic  functions  defined  on  J x J.  Let 
f^:  Cm(J)  > CP(J)  denote  the  linear  integral  operator  with  weighting 
pattern  (or  kernel)  W(t,  t);  that  is, 

t 

(2.2.8)  [fq(u)](t)  = / W(t,x)  u ( x)  dx,  t e J and  u £ Cm(J). 

A system  E = (F,G,H)  over  A(J)  is  said  to  be  a real ization  of  the 

operator  f^  defined  by  (2.2.8)  iff  = f £,  where  f^  is  the  response  map 
of  E given  by  (2.2.7).  A realization  of  fq  is  minimal  if  its  dimension 
is  minimal  among  all  possible  realizations. 
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Next,  we  review  some  realizability  criteria  for  an  integral 

operator  with  kernel  W(t,x).  We  shall  start  by  reviewing  a well 

known  result  due  to  SILVERMAN  and  MEADOWS  [1966]. 

t _ 

Given  Cm(J)  > Cp(J):  u fjj(u):  t + f W(t,x)u(x)dx,  for  each 

... 

positive  integer  l define 


(2-2-9)  BiMt.T)  - 


where 


Wn(t,T) 

W21(t,x) 


Wil(t,x) 


W |^(t ,x)  ••• 

^22  (T » x ) ••• 


W^Ct.T) 
W2i (t,t) 


W.2(t,x)  ...  W..(t,x) 


, t,x  e J, 


J “1  -1 


(2.2.10)  W.  . (t,x) : = — — =— y W(t,  x)  ; i , j e Z and  (t,  x)  e JxJ. 
J 3t  " 3xJ_i 


Note  that  the  matrices  W-jj's  are  well  defined  because  of  the  analyticity 
of  W(v). 

(2.2.11)  THEOREM  (SILVERMAN  and  MEADOWS  [1966]).  An  integral  operator 
ff]  is  realizable  if  and  only  if  there  exists  a finite  positive  integer  n 
such  that  B^n^(t,  x)  and  B,^n+^(t,  x)  both  have  rank  n almost 

everywhere  for  t > x.  Furthermore,  n is  the  dimension  of  a minimal 

realization  of  fpj. 
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It  is  worthwhile  to  observe  that  the  above  criterion  consists 
basically  in  checking  the  rank  of  an  infinite  collection  of  finite 
matrices  indexed  by  t,  t e J with  t > t. 

KALMAN  [1968a]  derived  a necessary  and  sufficient  condition  for 
realizability  of  a response  map  fg  specified  in  terms  of  the  rank  of  the 
matrices  Bg( t , t)|  , t e J. 

(2.2.12)  THEOREM  (KALMAN  [1968b]).  An  integral  operator  fR:  Cm(J)  + 

CP(J)  js_  realizable  if,  and  only  if,  there  is  a positive  integer  n , and 

for  every  closed  bounded  interval  I J there  is  a positive  integer  nj 

(k) 

such  that  rank  Bg  ' (t,  t)  = n for  all  tel,  and  al  1 k > n^. 
Further , n is  the  dimension  of  a minimal  realization. 

Even  though  the  above  result  may  be  considered  as  a one-variable 
criteria,  i.e.,  given  in  terms  of  Bg^(t,  t)  instead  of  Bq1' ^ (t , t) , it 
has  the  disadvantage  that  it  requires  the  computation  of  the  rank  of  an 
infinite  matrix  at  each  t e J. 

It  was  in  FLIESS  [1982,  1983]  that  a simpler  criteria  (at  least 
from  theoretical  point  of  view)  for  realizability  of  real  analytic  i /o 
maps  was  developed.  His  work  is  based  on  the  theory  of  representative 
series  (see  Chapter  Three)  and  on  the  theory  of  germs  of  analytic 
functions. 

It  is  well-known  that  the  kernel  W(t,x)  of  any  analytic  linear 
operator  fg:  Cm(J)  + C^(J)  has  a "natural"  power  series,  its  Taylor 
series  expansion;  that  is,  at  each  (t,  t)  e JxJ 
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00  00 


(2.2.13)  W(t,x)  = Z Z H..ti‘1Tj'1£Rpx”[[tl  t]]  , 

i =1  j=l 


where 


(2.2.14)  W 


9i-1 


for  each  i,jeZ+. 


t=x=0 


(assume  that  0 e J) . 

For  an  operator  fR  with  kernel  R(t,  t)  given  by  (2.2.13),  define  as  its 
characteri Stic  matrix  C(fpj)  the  following  infinite  block  matrix 


where  the  W^-'s  are  given  by  (2.2.14). 

Note  that  C(fjj)  is  not  a Hankel  matrix  as  in  (2.1.11)  because  it  is 
not  even  block  symmetric.  With  the  usual  definition  of  rank  for  an 
infinite  matrix  we  have  the  next  result. 

(2.2.16)  THEOREM:  (FLIESS  [1982]).  A scalar  analytic  i/o  map  f^: 

C(J)  C(J)  with  kernel  W(t,  x)  _is realizable  if  and  only  if  there 

exists  a finite  non-negative  integer  n such  that  rank  C(fjj)  = n. 
Furthermore,  n is  the  dimension  of  a minimal  realization. 


(2.2.15) 


20 


Hence,  to  check  for  realizability  of  a scalar  f^,  we  have  to 
calculate  the  rank  of  a single  infinite  matrix.  This  fact  "reduces"  the 
computations  considerably . Unfortunately,  Fliess  does  not  consider 
either  a theory  of  representative  series  with  matrix  coefficients  or  a 
concrete  minimal  realization  of  the  scalar  i/o  map  fn.  However,  from 
the  results  of  Chapter  Three  in  this  work,  the  multiple  input/multiple 
output  version  of  Theorem  (2.2.16)  can  be  deduced. 

Next  we  review  a realization  procedure  for  real  analytic  i/o  maps 
that  was  developed  in  KAMEN  [1979]  and  which  can  be  considered  as  a 
generalization  of  the  Si  1 verman-Meadows  algorithm  (see  SILVERMAN 
[1971]). 

Given  a linear  operator  f^,  specified  by 


fl7:  Cm(J)  - Cp(J):  u - fg(u)  = y:  t 


t _ 

/ W(t , T)u(t)dT 
ll 


for  each  t e J define  the  infinite  matrix 


(2.2.17) 


Bg(t)  = 


wn(t)  w12(t)  w13(t) 

W21(t)  w22(t)  w23(t) 

W3i(t)  ^32^)  ^(t) 


where 


ai-l  J-l  _ 

Wij(t)  = TT  ~TT  w(t’ 

J at  1 


» 1 , j e z 


T=t 
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The  matrix  B^(t)  is  called  the  (generalized)  Hankel  matrix  associated 

with  fjj  at  time  t.  Note  also  that  since  the  entries  of  Bjj  are  elements 

of  A(J),  can  be  seen  as  an  infinite  matrix  over  the  ring  A(J). 

Let  r.j  (ci ) denote  the  ith  elementary  row  (column)  of  the  Hankel 

matrix  Bjj.  Let  X^(X^)  denote  the  A(J)-module  generated  by  the 

I'-j  (ci ) • Here  addition  and  scalar  multiplication  are  defined 

componentwise.  Then  it  is  not  hard  to  see  that  a)  since  A(J)  is  a 

commutative  ring,  and  X^j  can  be  defined  as  left  or  right  modules 

p c 

over  A(J),  b)  X^  and  Xq  are  torsion-free  modules,  i.e.,  if  ax  = 0 for 
some  a e A(J),  x e Xg  or  x e xS  , then  a must  be  zero. 

Finally  denote  by  B^^(t)  the  submatrix  of  B^(t)  given  by 


Wn(t) 

W12(t) 

. . . 

"h 

(t) 

W21(t) 

• 

• 

W22(t) 

. . . 

W2i 

(t) 

wi2(t) 

. . . 

w. . 
1 1 

(t) 

(2.2.18)  THEOREM  (KAMEN  [1979]):  Given  the  operator  f^  with  associated 

Hankel  matrix  Bjj,  the  following  are  equivalent. 

(i)  The  operator  fjj  is  realizable  and  the  dimension  of  a minimal 
realization  is  n. 

(ii)  The  modules  Xg  and  Xg  are  finite  and  free  with  rank  X,1^  = 
rank  Xg  = r. 

( i i 1 ) ran^  Bq ' ^ (t ) = n for  all  k > y , al 1 t e J , for  some  integer  y . 
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Kamen  has  shown  the  above  theorem  by  giving  a concrete  realization 
of  fjj.  A key  contruct  in  his  algorithm  is  the  definition  of  the 
pseudolinear  differential  transformation 


X1 

xl+p 

l 

i — I 

• X 

i 

(2.2.19)  Xp:  X§  * X?: 

x2 

■¥ 

x2+p 

+ 

x2 

x3 

• 

x3+p 

• 

x3 

• 

• 

• 

where  p is  a fixed  positive  integer. 

To  see  that  Xp  is  well-defined  and  what  properties  it  has.  the 
reader  is  referred  to  KAMEN  [1979]. 

Let  us  assume  that  Xg  is  finite  and  free  with  rank  n,  and  define 
the  following  A ( J ) -1  inear  maps 


c \ 
u. 


3:  Am(J)  - X§: 


v -V 


m 

,ii 


A.  1_ 

c^=iL  -elementary  column  of  Bg, 


(2.2.20) 
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(2.2.21) 


H:  X§  * AP(J): 


— 

— 

X1 

X1 

X2 

> 

X2 

• 

• 

• 

• 

• 

X 

P 

s.  — 

Then  it  can  be  shown  (see  KAMEN  [1979])  that  a matrix  representation  for 
(7.pS  G,  H)  yields  a minimal  realization  of  frj  of  dimension  n. 

To  compute  a minimal  realization  of  f^,  the  following  is  needed. 


KAMEN' S ALGORITHM  FOR  CONSTRUCTION  OF  MINIMAL  REALIZATIONS 

(i)  Find  a positive  integer  n such  that  rank  B^(t)  = n for 
all  i > p,  all  t e J. 

(ii)  Let  N(t)  be  any  sxq  submatrix  of  such  that  s > p and 


with  rank  N(t)  = n for  all  t e J. 

(iii)  Find  matrices  E(t)  and  Q(t)  such  that  N(t)E(t)  = [Q(t)  I 0]. 
It  is  important  to  emphasize  that  E and  Q can  be  found  via  a 
finite  sequence  of  multiplications  on  the  matrix  N using  qxq 
invertible  matrices  over  A(J). 

(iv)  Let  a(t)  denote  the  submatrix  of  the  first  block  column  of 

corresponding  to  the  rows  of  N.  Let  oH  be  the 
submatrix  of  whose  first  column  is  located  m 
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elementary  columns  to  the  right  of  the  first  column  of  N and 
whose  rows  correspond  to  those  of  N. 

(v)  Define 


(2.2.20)  F:=  first  n-columns  of  -(QTQ) "*QT( (aN)E  + NE)  , 

(2.2.21)  G:=  [QTQ]_1  QTa  , 

(2.2.22)  H:=  first  p-rows  of  Q 


Then  E = (F,  G,  H)  is  a minimal  realization  of  fjj. 

It  is  worthwhile  to  emphasize  that  F,  G,  H are  the  matrix 

representations  of  X 5,  H (see  (2.2.19-21))  with  respect  to  some 

P 

basis  v^,  Vg,  ...,  vn  of  Xg  satisfying 


[v^t),  v2(t),  ...,  vn(t)]  = 


Q(t) 


and  with  respect  to  the  respective  standard  bases  of  Am(J)  and  Ap(.J). 

Let  A(J)nxrn  denote  the  set  of  nxm  matrices  over  A(J).  Given  the 
m-input  p-output  n-dimensional  system  E = (F,  G,  H)  over  A(J),  define 


(2.2.23) 

(2.2.24) 


Dp  : A(J)nxm  * A(J)nxm:  M + -FM  + M 
Dp  : A(J)nxp  -*•  A(J)nxp  : M -*•  -FM  + M 
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• ^ T 

where  M is  the  derivative  of  M and  F = -F  . The  maps  Dp  and  Dp  are 

called  the  differential  transformations  associated  with  E . 

For  each  positive  integer  i,  let  and  0^  denote,  respectively, 

the  itfl  reachability  and  i^-observabi  1 ity  matrix  of  E;  that  is 


(2.2.25)  R.  = [G,  Dp(G) , ...,  Dj_1(G)]  , 


(ht)t 

(Dp(HT) )T 


(2.2.26)  0. 


i -1  j j 

(Dp  (H1))1 


where  Dp  1 ( Dp  ) is  the  (i  - 1)  - fold  composition  of  Dp(Dp). 

A system  E = (F,  G,  H)  over  A(J)  is  said  to  be 
(observable)  iff  rank  Rn(t)  = n (rank  0n(t)  = n)  for  each  t 
system  E is  canonical  if  it  is  both  reachable  and  observable. 


reachabl e 
e J.  The 


(2.2.27)  DEFINITION:  A continuous  time-varying  system  E = (F,  G,  H)  is 
said  to  be  a constant  rank  system  if  there  exist  positive  integers  a,  3. 
nr  3nd_  nQ  such  that  F(t),  G(t),  and_  H(t)  are_  max  (a,  e)-l,  a and  3 times 
continuously  differentiable,  and  such  that 


rank  Ra(t)  = rank  Ra+1(t)  = n^  < n for  each  t e R 

rank  0g(t)  = rank  0 ^t)  = nQ  < n 


for  each  t e R 
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From  results  due  to  Silverman  [1971],  we  have  the  following  useful 

fact . 


(2.2.28)  THEOREM.  Let  f^  : Cm(J)  -*■  (^(J)  be  an  integral  operator 
with  kernal  W(t,  t)  over  A(JxJ),  and  let  £ be  a constant-rank 
realization  of  f^.  Then  E is  a minimal  realization  if  and  only  if  it  is 
canoni cal  . 

As  noted  by  SILVERMAN  [1971]  when  J is  bounded  any  analytic  system 
£ is  constant  rank.  In  KAMEN  [1979],  it  was  shown  that  when  J is 
unbounded  an  analytic  system  is  not  in  general  constant  rank. 

Furthermore,  he  has  shown  the  following  interesting  result  which  we 
shall  use  later  for  comparison  purposes. 

(2.2.29)  THEOREM  (KAMEN  [1979]).  Let_  fg  : Cm(J)  + CP(J)  be  an 
operator  in  the  sense  of  (2.2.8).  Then  fjj  is  realizable  by  a constant- 
rank  system  if  and  only  if  there  exist  positive  i ntegers  n and  u such 
that 


rankB^1 ^ (t)  = n 


for  all  i > y and  all  t e J 


In  addition,  n is  the  dimension  of  a minimal  realization. 
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2.3  Discrete  Time-Varying  Systems 
Let  Z denote  the  ring  of  integers  and  let  K be  an  arbitrary,  but 
otherwise  fixed,  field.  For  any  n in  Z+,  the  set  of  all  positive 
integers,  we  let  Kn  denote  the  K-vector  space  of  all  n-element  column 
vectors  over  the  field  K.  Let  B be  the  K-linear  space  of  all  functions 
with  domain  Z and  codomain  K.  With  addition  and  multiplication  defined 
by 


(a  + b)(k)  = a(k)  + b(k) 

(ab) (k)  = a(k  )b(k ) 

for  all  a,  b in  B,  and  all  k e Z,  B becomes  a commutative  ring  with 

identity  1,  where  l(k)  = 1 for  all  k e Z. 

Let  a:B-*-B:a*aa:k  + a(k  - 1)  be  the  right-shift  operator 
on  3.  The  operator  a is  a (ring)  automorphism  on  B;  that  is.  a is 

bijective  and  o(a  + b)  = aa  + ah,  a(ab)  = (0a) (ab)  for  all  a,b  e B.  The 

inverse  a"1  of  a is  the  left -shift  operator  on  B defined  by 

a^:B->-B'  a 0 ^a  : k -►  a(k+l).  The  ring  B with  the  automorphism 

a is  said  to  be  a di fference  ring. 

Let  B+(B_)  denote  the  subring  of  B consisting  of  all  functions  with 
support  bounded  on  the  left  (right);  that  is,  for  any  a e B+  (Bj  there 
exists  an  integer  kg,  which  depends  on  a in  general,  such  that  a(k)  = 0 
for  all  k < ka  (k  > kg).  For  any  positive  integer  n,  let  b"  (Bn)  denote 
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the  K-vector  space  of  all  n-element  column  vectors  with  entries  in  B+ 
(BJ. 

A subring  A of  B is  said  to  be  a difference  subring  if  A is  closed 
under  a,  i.e.,  a( A)  = A.  In  terms  of  these  concepts  we  have  the 

following  notion  of  a system. 

(2.3.1)  DEFINITION:  Let  m,n  and  p be  fixed  positive  integers  and  A be 

a difference  subring  of  R.  An_  m-i nput  p-output  n-dimensi onal  linear 

time-varying  discrete-time  system  over  A is  a triple  £ = (F,  G,  H)  of 
nxn,  nxm,  pxn  matrices  over  A,  together  with  the  dynamical  equations 

(2.3.2)  x(k  + 1)  = F(k)x(k)  + G(k)u(k) 

, k z Z. 

(2.3.3)  y(k)  = H(k)x(k) 

where  x(k)  e Kn  is  the  state  of  the  system  at  time  k e Z,  u(k)  e Km  j_s_ 
the  system  input  or  control  law  at  time  k,  and  y(k)  e KP  is  the  system 
output  at  time  k. 

As  in  KAMEN  and  HAFEZ  [1979],  we  shall  work  with  a modified  version 
of  the  standard  equations  (2.3.2)  and  (2.3.3).  Apply  the  right-shift 
operator  a to  both  sides  of  (2.3.2)  and  let  D(k)  :=  F(k  - 1),  E(k)  : = 
G(k  - 1).  This  gives  the  following  equation 


(2.3.4) 


x(k)  = D(k)x(k  - 1)  + E(k)u(k  - 1) 
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Henceforth,  we  shall  be  specifically  concerned  with  the  time-varying 
system  £ = (D,  E,  H)  over  A defined  by  the  dynamical  equations  (2.3.4) 
and  (2.3.3). 

The  state  transition  matrix  of  a system  £ is  the  nxn  matrix 
function  <t>  (k , 1)  defined  by 


(2.3.5) 


D(k)D(k  - 1) 

...  0(1+1)  , k > 1 , 

I , 

, k = 1 , 

undef i ned 

, k < 1 , 

where  I is  the  nxn  identity  matrix. 

As  is  well  known,  the  unit-pulse  response  function  W^(k,  1)  is 
given  by 


(2.3.6) 


WE(k,  1)  = 


H(k)4»(k,  1 + 1)  E(1  + 1),  k > 1 , 

0 , k = 1 , 

pxm  * 

undefined  for  k < 1 , 


where  0pXin  is  the  zero  matrix  of  dimension  pxm. 

The  input/output  behavior  of  a system  £ is  described  by  its 
input/output  map  f : B™  ->  bJ  given  by 


k 

[fE(u)](k)  = £ 

1 = -a 


Wy(k,  l)u(l) 


u e 8 


m 


(2.3.7) 
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(2.3.8)  DEFINITION:  Given  a linear  system  S = (D,  E,,  H)  over  A,  its 

A AAA 

dual  is  a system  Z = (D,  E,  H)  over  A,  where 


(2.3.9) 


“in1 
a D 


-IJ 

a E 


(T  = transpose  operation) 


and  whose  dynamical  equations  are 

(2.3.10)  z(k  - 1)  = D(k)z(k)  + E(k)v(k) 

(2.3.11)  w(k)  = H(k)z(k)  , k e Z 

wherg  z(k)  £ Kn  is  the  system  state  at  time,  k,  v(k)  e kP  is  the  system 
input  input  applied  at  time  k,  and  w(k)  e Km  is  the  system  response  or 
system  output  at  time  k. 

a 

It  is  interesting  to  observe  that  s evolves  in  reverse  time. 

/V 

The  state  transition  matrix  of  the  dual  Z of  a system  E over  A,  is 
defined  as 


0T(k  + 2)DT(k  + 1)  ...  DT(  1 + 1)  , k < 


2.3.12)  <t>(k,  1)  - < 


undefi ned 


, K = 1 , 

, k > 1 , 


where  I = nxn  identity  matrix. 
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It  is  very  easy  to  show  that  the  unit-pulse  response  matrix 

a 

function  W*  associated  with  z is  given  by 


(2.3.13) 


ET(k  + 1 ) J(k , 1 - 1)HT(1)  , k < 


W£(k,  1)  = 


0 

mxp 

undefi ned 


, k = 1 

, k > 1 , 


"here  0fflxp  = [0]mxp. 

A 

The  input/output  behavior  of  z is  given  by  its  input/output  map 


(2.3.14) 


+oo 


ft:  8P  * Bm  : v * ft  : k - Z W;(k,  l)v(l) 
L Z l=k  E 


where  f*  will  be  referred  to  as  the  response  map  of  the  dual  system  z. 
By  comparing  (2.3.5)  and  (2.3.12)  we  observe  at  once  that 


(2.3.15)  <(,  ( k , 1 - 1)  = <>  (1,  k + 1)  for  all  k < 1 


and  we  get  the  following  result 

(2.3.16)  PROPOSITION:  Given  a linear  system  Z = (0,  E,  H)  over  A, 

its  unit  pulse  response  matrix  function  WE  is  related  to  the 
correspondi ng  one  W^(»,  »)  of  the  dual  system  z through  the  relation 

W^,(k,l)  = W~T(1,  k)  for  all  k > 1 


(2.3.17) 
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PROOF:  Take  the  transpose  of  W£(»,  •)  in  (2.3.13),  use  (2.3.15),  and 

compare  with  (2.3.6) . 

(2.3.18)  DEFINITION:  Let  m and  p be  fixed  positive  integers.  An 

m-input  p-output  linear  time-varying  causal  input/output  map  fw  is  a 
K-1 inear  map 


f • «m  rP 
fW  • B+  + B+ 


such  that  if  u(k)  = 0,  k < ku,  for  some  u e , then  [fw(u)](k)  = 0 

for  all  k < k . 

u 

It  is  a well  known  fact  that  for  any  input/output  map  f^  as  defined 
above,  there  exists  a pxm  matrix  function  W(k,  1)  such  that  for  any 
u e B™, 

k 

(2.3.19)  [fw(u)](k)  = E W(k,  l)u(l) 

1 =-“> 

By  causality  W(k,  1)  = 0 for  k < 1.  The  matrix  function  W is  the  unit- 
pulse  response  function  associated  with  the  input/output  map  fw* 
Furthermore,  if  we  denote  by  CP  the  (strictly)  causal  half-plane  of  ZxZ; 
that  is, 


(2.3.20)  CP  = {(k,  1)  £ Z x Z : k > 1} 
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we  observe  that  W is  a function  with  domain  CP  U {(k,  1)  e Z x Z : 
k = 1}  and  codomain  KPxm  satisfying  W(k,  k)  = 0 for  all  k e Z. 

Our  next  concept  is  the  notion  of  realizability. 

(2.3.21)  DEFINITION:  Let  Z = (D,  E,  H)  be  an  m-input  p-output 

n-dimensional  linear  system  over  A and  fw  : B™  -*■  8^  be  an  i/o  map 
defined  by  (2.3.19).  Z is  said  to  be  a realization  of  fw  if,  and  only 
i f » - fg,  where  f^  is  the  response  map  of  Z given  by  (2.7) . The  i/o 

map  f^  is  said  to  be  realizable  if  there  exists  a realization.  A 
realization  is  minimal  if  there  is  no  realization  having  smaller 
dimension . 

Assume  that  z = (D,  E,  H)  is  a realization  over  A of  fw,  then  from 
the  above  definition 

fw(u)  = fE(u)  , u e Qm+  . 


That  is 


k 

s [W(k,  1)  - W_(k,  l)]u(l)  =0  , u e Bj,  k e Z . 

l*-«  Z + 

But  it  is  not  hard  to  see  that  such  an  equality  implies 

W(k,  1 ) = WE(k,  1)  for  all  (k,  1)  e CP  . 


(2.3.22) 
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Conversely,  if  (2.3.22)  holds,  then  it  must  be  clear  that  Z realizes 
fw.  We  have  thus  shown 

(2.3.23)  PROPOSITION:  A system  Z = (D,  E,  H)  over  A is  a realization 

of  the  i/o  map  fw  if,  and  only  if 

W(k,  1)  = WE(k,  1)  for  all  (k,  1 ) e CP 

Given  a linear  i/o  map  f^  : B™  + B^  with  unit-pulse  response 
function  W(*,  •),  define  as  its  dual,  f~,  the  linear  i/o  map  given  by 

(2.3.24)  ff  : Bp  * Bm  : v + f*(v)  : k + z W(k,  l)v(l) 

1 =k 


where 


W(k,  1)  = WT(1 , k)  for  all  (1  , k)  e CP 
The  above  concept  leads  us  to  the  following  result. 

(2.3.26)  PROPOSITION:  If  a given  i/o  map  f^  : 8™  ■>  8+  with  unit- 

pulse  response  W(*,  •)  is  realizable  by  the  system  Z = (D,  E,  H) 

over  A,  then  its  dual  map  fQ  : B^  B™  is  realizable  by  the  system 
~ _i  x T -IT 

Z = {a  0 , H , a E ),  the  dual  of  z.  Conversely,  if  the  system 

A 

Z = (D,  E,  H)  over  A is  a realization  of  f",  then  the  dual  system  Z 
is  a realization  of  f^. 
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In  definitions  (2.3.1)  and  (2.3.21),  it  is  important  to  note  that 
by  selecting  the  difference  subring  A,  we  can  restrict  attention  to  a 
particular  class  of  systems.  For  instance,  if  A = 1°°(Z)  = set  of  all 
bounded  functions  from  Z into  R,  we  are  able  to  study  linear  time- 
varying  systems  with  bounded  coefficients.  However,  in  this  work  we 
shall  assume,  in  general,  that  A = B,  unless,  of  course,  we  need  to  make 
more  specific  any  result. 

Next,  we  review  some  basic  definitions  and  some  structural 

properties  of  linear  n-dimensional  discrete  time-varying  systems  which 
will  be  used  in  the  subsequent  work. 

We  shall  start  by  introducing  the  concept  of  a semi  linear 
transformation  (s.l.t.)  associated  to  a system  E = (13,  E,  H)  over  B (see 
definition  (2.3.1))  which  was  used  for  the  first  time  by  KAMEN  and  HAFEZ 
[1979]  in  the  study  of  discrete  time-varying  systems. 

Let  Bn  represent  the  free  B-module  consisting  of  all  n-element 
column  vectors  over  B.  Given  an  nxn  matrix  M over  B,  let  S denote  the 
operator  defined  by 

(2.3.27)  S : 8n  > 6n:v  * M(av) 

where  (crv)(k)  = v(k  - 1)  , k e Z. 

By  using  (2.3.27)  we  observe  that  S has  the  following  properties: 

(i)  S is  additive;  that  is,  S ( v ^ + v2)  = S(v^)  + S(v2)  for  all 
v^,  v 2 s 8n.  To  see  that,  note 
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S( v i + v2)  = Ma(v^  + v2)  = M(av^  + ov^)  = Mav^  + Mav^ 

= S(vx)  + S(v2). 

(ii)  S is  not  homogeneous.  For  let  a e B,  and  let  v e 8n,  then 
we  have  that 

S(av)  = M(a(av))  = M(cra)(crv)  = (aa)M(av)  = (aa)S(v)  * aS(v). 


Therefore,  S is  not  a linear  operator  with  respect  to  the  B-module 
structure  on  Bn . The  operator  S is  said  to  be  a semi  1 inear 
transformation  relative  to  a (see  JACOBSON  [1937]). 

Next,  let  £ = (0,  E,  H)  be  an  n-diinensi onal  system  over  B (see 
definition  (2.3.1)).  The  operator  S : 8n  -*■  Bn  : v ■>  D(av)  will  be 
referred  to  as  the  semi  linear  transformation  (s.l.t.)  of  the  system 
£ = (D,  E,  H).  Also,  let  us  define  the  following  recurrent  relation: 

S'E  : = D[cr(Si-1E)]  , i e Z+ 

(2.3.28) 

S°  = I = identity  operator 


We  shall  also  find  useful  the  notion  of  the  dual  of  a s.l.t.  S (see 
HAFEZ  and  KAMEN  [1979]). 
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(2.3.29)  DEFINITION:  Consider  a given  s.i.t.  S (see  (2.3.27)),  its 

A A 

dual  S is  the  mapping  S defined  by 

(2.3.30)  S : 8n  •>  Bn  : v + ct-1(MTv) 

where  M is  the  same  nxn  matrix  over  B used  to  define  S. 

A 

It  is  not  hard  to  show  that  the  dual  S of  a s.i.t.  S relative  to  a 
is  a s.i.t.  relative  to  a-1. 

Next,  consider  the  dual  system  £ = (6,  E,  H)  over  B of  E = (0,  E, 
ri)  (see  definition  (2.3.8))  whose  dynamical  equations  are 

z(k  - 1)  = 0T(k  + l)z(k)  + HT(k) v(k)  , 

w(k)  = ET(k  + l)z(k) 

The  operator  S : 8n  ■*  B'n  : a > a ^(D^"a)  will  be  referred  to  as  the 

A 

s.i.t.  of  the  dual  system  £ . Also,  let  us  define  the  following 
recursive  expression 

SjHT  = a“1[0T(Sj_1HT)]  , j e Z+ 

(2.3.31) 

A 

S°  = I = identity  operator. 

A system  £ = (D,  E,  H)  over  3 is  said  to  be  reachabl  e (in  N 
steps)  at  all  times  if  and  only  if  there  exists  a positive  integer  N 
such  that  for  any  k e Z and  any  x e 3n  there  exists  an  input  sequence 
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u(k  - N) , u(k  - N + 1),  u(k  - 1)  which  drives  £ from  x(k  - N)  = 0 

to  x(k)  = x.  The  dual  notion  of  observability  in  N steps  can  be  given 
the  usual  system  interpretation.  That  is,  E is  observable  (in  N steps) 

a 

if  its  dual  £ is  reachable  in  N steps. 

It  is  possible  to  find  necessary  and  sufficient  conditions  for  a 
given  system  E = (D,  E,  H)  to  be  either  reachable  or  observable  in  N 

A 

steps  by  using  the  system's  semilinear  transformations  S and  S.  The 
following  results  are  basically  due  to  WEISS  [1972]  (see  also  KAMEN  and 
HAFEZ  [1977]). 

For  any  fixed  positive  integer  i,  denote  by  R.j  ( O-j ) the  itri 
reachability  (observability)  matrix  of  E defined  by 

Ri  = [E,  SE,  ...,  S1_1E]  , 


(2.3.32) 


T * T * -j  _ i T 

o!  = [H1,  SH1,  ...,  S1  V])  . 

(2.3.33)  THEOREM:  An  n-dimensi onal  system  E = (0,  E,  H)  over  B is 

(i)  reachable  in  N steps  at  all  time  if,  and  only  if 

rank  R^(k)  = n , for  all  k e Z , 
i *2 • > if  and  only  if  is  ri ght-i nverti b 1 e over  B. 


(ii)  Observable  in  N steps  at  all  times  if,  and  only  if 
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rank  0N(k)  = n , for  all  k e Z 
i .e . if  and  only  if  0^  is  left-invertible  over  6. 

A system  E = (D,  E,  H)  over  B is  said  to  be  canoni cal  if  it  is  both 
reachable  and  observable. 

(2.3.34)  REMARK:  Here  we  observe  another  basic  difference  between 

continuous-time  and  discrete-time  systems.  That  is,  the  notion  of 
reachability  is  not  the  same  for  both  of  them.  For  the  latter  kind  of 
systems,  reachability  (in  N steps)  is  expressed  in  terms  of  a rank 
condition  on  the  Nth-reachabi  1 i ty  matrix  R^  : = [E,  ...,  SN-1E]  at  each 
k e Z,  often  N > dim  E (see  example  (2.3.35));  furthermore  it  has  a 
definite  dynamical  interpretation.  While,  for  continuous-time  system 
the  natural  counterpart  would  be  to  define  reachability  in  terms  of  the 
rank  of  :=  [G,  DpG,  ...  Dp  ^G]  at  each  t e J with  N > dim  E; 
however,  such  a notion  has  not  been  used  nor  has  it  been  given  a system 
interpretation.  By  duality,  the  above  also  holds  for  observability. 

Such  a discrepancy  is  another  reason  why  it  is  not  true  that  the 
theory  of  realization  for  discrete-time  systems  is  just  a carry  over  of 
the  existing  one  for  continuous-time  systems. 


1 k 

0 

(2.3.35)  EXAMPLE:  Suppose  that  D(k)  = 

1 1 

, e(k)  = 

1 

(2.3.28)  it  is  not  hard  to  see  that 
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(Se)(k) 


(S2e)(k) 


2k -1 
k 


Hence, 


R2(k)  = [e( k ) ( Se ) ( k ) ] = 


cl  early 


rank  R,,(k)  = < 


On  the  other  hand, 


rank  R^k)  = rank 


0 k 

1 1 


k = 0 


k * 0 


0 k 2k -1 

1 1 k 


= 2 for  all  k e Z 


That  is,  Z = (0,  e,  -)  is  reachable  in  three  steps;  i.e.,  N = 3; 
however,  it  is  not  reachable  in  two  steps  (the  dimension  of  Z). 

The  first  work  on  realization  theory  of  discrete  time-varying 
systems  is  due  to  EVANS  [1972]  and  WEISS  [1972].  We  shall  review  first 
some  results  of  the  first  author. 

Recall  that  the  causal  half-plane  CP  has  been  defined  as 


CP  = {(k,  1)  e Z x Z : k > 1} 


(see  Figure  1). 
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Lat  \ be  any  fixed  integer,  and  let  us  denote  by  CP^  the  following 
proper  subset  of  CP, 

CPX  = { (k , 1)  eZxZ  : k > \ > 1 } 

It  is  immediate  to  observe  that  the  family  (CP  : \ z Z}  has  the  next 

K 

properties, 

(i)  Each  CP^  is  rectangular  in  form  (see  Figure  2); 

(ii)  (CP^  : X e Z}  forms  a cover  for  CP;  that  is, 

CP  = U CP^  . 

\eZ  X 

(2.3.37)  DEFINITION:  A system  E = (D,  E,  H)  over  B is  said  to 

realize  a linear  i/o  map  f,^  : B™  ■+  ^n_  CP^,  \ = fixed  integer,  if 

and  only  if 


(2.3.38)  rt(k,  1)  = W (k,  1)  for  all  (k,  1)  e CP. 

A.  i 

where  W (•,  •)  is  the  unit-pulse  response  matrix  of  S (see  (2.3.6)). 
In  such  a case,  we  also  say  that  fu  is  realizable  on  CP,. 
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'k. 


Causal  Half-Plane  CP, 

Corresponds  to  Hatched  Region.  Corresponds  to  Hatched  Region 

(2.3.38)  PROPOSITION  (EVANS  [1972]):  An  input/output  map  f ^ : 6™  ->  Bp 
with  unit  pulse  response  matrix  W(«,  •)  is  realizable  on  CP,,  where  \ 
is  a fixed  integer , if  and  only  if  there  exist  matrix  functions 

(2.3.39)  Px(.)  : (k  e Z : k > X}  - KPxn  , 

(2.3.40)  Qx(.)  : (1  e Z : X > 1}  - K°Xm  , 

with  n finite,  such  that 


(2.3.41) 


W(k,  1)  = px(k)Qx(l)  for  all  (k,l)  e CP^  . 
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PROOF : (Necessity).  Assume  that  is  realizable  on  CP^  by  a system 

E = (D,  E,  H)  of  dimension  n.  Then  by  definition 

W(k , 1)  = H(k)<}>(k,  1 + 1 ) E ( 1 + 1)  , for  all  (k,  1)  e CP  . 

K 


But 


( k , 1 + 1)  = <)>(k,  X + 1)<{)(X,  1+1)  , for  all  (k,  1)  e CP.. 

K 


Thus 


W(k,  1)  = P\(k)Q\(  1 ) for  (k>  1)  e CP^ 


where 


P (k)  :=  H(k ) <j)(k , X + 1)  , k > x 

A. 

Qx(l)  :=  4>(X,  1 +1)E(1  +1)  , X > 1 . 

It  must  be  clear  that  P and  Q satisfy  the  raqui  rements  of  the 

A.  A. 

proposition 

(Sufficiency).  Suppose  that  there  exist  pxn  and  nxm  matrices  P (•) 
and  Q (•)  satisfying  (2.3.39)  and  (2.3.40)  together  with  (2.3.41). 
Then,  it  is  obvious  that  the  system  E = (In,E,H)  is  an  n-diinensi onal 
realization  of  fw  on  CP^,  where  E(k)  = O^(k-l),  for  k < X and  E(k)  = 0 
for  k > X;  H(k)  = Px(k)  for  k > X and  H(k)  = 0 for  k < X. 


□ 
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The  next  result  links  the  individual  realizations  of  on  each  CP^ 
to  get  a criteria  for  realizability  on  the  entire  causal  half-plane  CP. 

(2.3.42)  PROPOSITION  (EVANS  [1972]):  An  i/o  map  f , , : Bm  - BP  is 

realizable  on  CP  if,  and  only  if,  for  each  X e Z fw  is  realizable  on  CP^ 
by  an  n-dimensi onal , linear,  time-varying,  discrete-time  system 

E = (0,  E,  H),  for  some  finite  n independent  of  X. 

The  greatest  drawback  of  the  above  criteria  is  that  it  is  necessary 
to  check  realizability  of  fw  on  each  CP^  by  factorizing  W(*,  •)  as 
in  (2.3.41).  And  it  is  a well-known  fact  that  the  separation  of  W(k,l) 

into  a product  of  two  matrices  P (k)  and  Q (1)  is  not  an  easy 

A.  A. 

task.  It  is  our  intention  to  circumvent  this  problem  and  to  give  more 
explicit  criteria  for  realizability.  Furthermore,  EVANS  does  not  give  a 
concrete  realization  of  f^. 

WEISS  [1972]  was  the  first  one  to  attack  the  problem  of 

constructing  minimal  realizations  for  certain  kinds  of  i/o  maps. 

Given  a linear  i/o  map  f^:  B™  * with  unit-pulse  response 
W(k,  1),  define  for  a fixed  positive  integer  i the  following  matrix 


W(k ,k-l) 


W(k,k-2) 


W(k,k-i ) 


W(k+l,k-l)  W(k+l,k-2) 


W(k+l,k-i ) 


, k e Z. 


W(k+i-l,  k-1)  W(k+i -1 , ,k-2) 


W(k+i - 1 , k -i ) 


(2.2.43) 
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(2.3.44)  THEOREM  (WEISS  [1972]).  Let  f,,  : 8™  -►  6^  be  a linear 
input/output  map  with  unit  pulse  response  matrix  W(»,  •).  Assume  that 
f^j  has  an  n-dimensi onal  realization  Z = (F,  G,  H)  (see  definition 
(2.3.1)),  and  for  some  N e Z+,  B^  contains  a fixed  nxn  submatri x r 
which  is  invertible  over  6.  Then  there  exists  a canonical  realization 
over  B _of_  fw  given  by 


z = (r.r"1,  A,  <j>r_1)  , 


where 

(M) 

A = submatri x of  B,^  ' consisting  of  those  rows  of  the  first 

block-column  whose  indices  match  those  of  the  rows  of  r, 

(N) 

<i>  = submatrix  of  B,^  ' consisting  of  those  columns  of  the  first 
block-row  whose  indices  match  those  of  the  columns  of  r. 


r i = the  nxn  submatrix  of  B 


(N+l) 


W 

(N), 


whose  column  positions  are  the 


and  whose  i t n -row  is  positioned 


same  as  the  ones  of  r in  B, , 

p-ei ementary  rows  below  the  ith  row  of  r. 

This  algorithm  is  structurally  analogous  to  the  one  given  by 

SILVERMAN  and  MEADOWS  [1969]  in  the  realization  of  time-varying 

continuous-time  systems.  The  major  drawback  of  the  WEISS  realization 

procedure  is  the  unnecessary  constraint  that  there  exists  an  nxn 
( N1 

submatrix  r of  B^  invertible  over  B.  In  Chapter  Eight,  we  shall 
develop  an  algorithm  for  construction  of  canonical  realizations  which 


eliminates  this  constraint. 


CHAPTER  THREE 

LOCAL  REALIZABILITY  CRITERIA  BASED  ON  THE  THEORY 
OF  GENERALIZED  REPRESENTATIVE  SERIES 


In  Chapter  Two  we  discussed  the  importance  of  the  generalized 
Hankel  matrix  in  finding  necessary  and  sufficient  conditions  for 
realizability  of  either  time-invariant  or  real  analytic  i/o  maps.  It 
was  also  observed  how  naturally  formal  power  series  arise  in  the  theory 
of  realization  for  these  classes  of  systems.  However,  in  the  discrete 
time-varying  problem,  Hankel  matrices  and  power  series  have  either  not 
been  fully  utilized  or  have  not  been  considered  at  all  (one  exception  is 
the  skew  power  series  approach  given  in  the  Ph.D.  dissertation  of  POOLLA 
[1984]). 

In  this  part  of  the  work,  we  shall  first  develop  some  aspects  of 
the  theory  of  generalized  representati ve  series.  This  will  be  used  to 
derive  a realizability  criterion  based  on  the  concept  of  the 
(generalized)  Hankel  matrix  associated  with  a discrete  i/o  map.  It 
should  be  mentioned  that  these  results  are  the  multivariable  version  of 
the  theory  developed  by  FLIESS  [1982,  1983]  on  realization  of  "scalar" 
real  analytic  i/o  maps.  Also,  it  is  believed  that  the  introduction  of 
representati ve  formal  power  series  in  the  theory  of  discrete-time 
systems  is  new. 
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3.1  Generalized  Representative  (Formal)  Power  Series 
Let  K be  any  fixed  commutative  field.  Given  fixed  positive 

integers  m and  p,  we  shall  denote  by  KPxm[[t ,t]]  the  K-vector  space  of 
all  formal  power  series  over  KPxm  in  the  two  indeterminates  t and  t. 
That  is,  an  element  W in  kPxit1  [ [t , t]]  is  of  the  form 

W = E W.  .ti_1Tj_1  : = E E W..t1_1Tj_1  , W.  . e Kpxm  . 

i,j>l  1J  i-1  k-1  1J  1J 

Recall  that  given  K-vector  spaces  A,  B,  C,  a mapping  f : AXB  -*•  C is 
said  to  be  bilinear  if  it  has  the  following  properties 

(i)  f(riai  + r2a2’  V = r1f(a1»b1)  + r2f(a2,b1) 

(3.1.1) 

(ii)  f(a1,r1b1  + r2b2)  = r^a^b^  + r^a^b^ 
for  all  a^,  e A,  all  bj_,  b£  e B,  and  all  r^,  t K. 

(3.1.2)  DEFINITIONS:  Let  A,B  be  two  K-vector  spaces.  The  tensor 

product  of  A and  B is  a pair  (A  0 B,  a)  where  A 0 B i s a K-vector 
space,  and  a is  a bilinear  mapping  of  A x 8 + A 0 B such  that  for  each 
choice  of  a K-vector  space  C,  and  of  a bilinear  mapping  p : A x B * C, 


there  exists  a unique  K-homomorphi sm  6 : A 0 8 * C for  which  the 
di agram 
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»A0B 


6 


commutes ; i .e . , 6a  = p . 

Given  an  integer  a,  let  us  define  the  following  proper  subsets  of 
Z: 

(3.1.3)  Z+  = {k  g Z : k > a) 

a 

(3.1.4)  1 = {k  e Z : k < a -1} 

a 

Also,  for  any  fixed  positive  integer  m,  Km  (Km)  shall  denote  the 
K-vector  space  of  all  m-element  column  (row)  vectors  whose  entries  are 
over  K.  Furthermore,  for  any  K-vector  space  S and  any  subset  Z of  Z, 
SZ  will  represent  the  K-l inear  space  of  all  S-valued  functions  on  Z. 

In  the  sequel  \ will  denote  an  arbitrary  fixed  integer  and  I will 
denote  a finite  set. 

Define  the  following  canonical  morphism  of  K-vector  spaces 

0 z:  Z"  Z^xZf 

(3.1.5)  n :(KP)  X 0(K  ) X ->•  (KP°)  X X 


and 
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*(  E 9i)(k,  1)  :=  E f . (k)g.  (1 ) 

i el*  1 1 i el  1 1 


The  next  result  is  a generalization  of  proposition  (1.2),  Chapter 
One  in  HOCHSCHILD  [1981]. 


(3.1.6)+  PROPOSITION:  The  canonical  morphism  n : (K*3)  ^ « (K  ) ^ -► 

(Kpxm)  ^ ^ is  injective  and  its  image,  I mu,  consists  of  all  functions 
h with  the  property  that  the  K-l  inear  space  spanned  by  the  partial 
functions  h-,  , where  1 ranges  over  Z~  and  h,(k)  :=  h( k ,1 ) , is  finite- 

' A.  I 

dimensional . 


PROOF:  Let  £ = E f-idg.;  be  any  element  of  the  kernel  of  n,  and  let  V 

J = 1 , 7+  J 

be  the  K-space  of  (KP)^  generated  by  f^,  f2,  ...»  fp.  That  is, 


V :=  <f 


1’  2’ 


Vk 


If  V = (0),  then  the  given  element  of  ker-rc  is  in  the  "zero"  element  of 
Z+  Z~ 

(KP)  ^0(Km)  \ and  there  is  nothing  to  be  shown.  Otherwise,  we  choose  a 
basis  {v^,  V2>  •••,  vn>  for  V.  Hence,  we  have  that  for  each  j from  {1, 
2,  ...,  r}  there  exist  scalars  a^,  a2j,  ...,  anj  in  K such  that 


f . 
J 


n 

= £ a. .v. 
1-1  1J  1 


r r n 

5 = E f . 0 g . = £ ( £ a.  .v.)  a g . , 
j-1  J J j-1  i-1  1J  1 J 


Then 
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and  by  using  well-known  properties  of  the  tensor  product,  we  obtain 


n 

(3.1.7)  5 = E v.0  h , 

i =1  1 1 


where 


j=l 


a,  .g. 
lJaJ 


Next,  we  apply  n to  5 in  (3.1.7)  to  get 


n n 

*(£)  = l v.  0 h. ) = l v.  h 
i=l  1 1 i =1  11 


But,  note  that  it(5)  = 0 m by  assumption.  Therefore 


vihi  = [vl'  v2>  vn] 


= 0 


pxm 


Oafi ne 


B :=  [v  , v , ...,  v ] 

H :=  [hj,  hg,  h^]T 
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to  obtain 


u(l)  = BH  = 0 


pxm 


Let  1 be  an  arbitrary,  but  fixed,  element  of  Z . Then 


8H(1 ) = 0 


pxm 


Since  the  columns  of  B are  linearly  independent,  we  must  conclude  that 


H(  1 ) = 0 


nxm 


That  is,  at  each  1 e Z 


h.(l)  = 0 


Hence,  we  have  that 


for  i = 1,  2,  . . . , n 


h..  = 0 for  i = 1,  2 n 

By  using  (3.1.7),  we  observe  then  that  l can  be  written  as 

i = I v a o = ( l v ) a o . 
i=l  i =1 
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Finally,  it  is  not  hard  to  show  by  using  (3.1.1)  tnat  any  element  in 
Z+  z" 

(KP)  x 8 (1^)  x of  the  form  a 8 0 is  zero.  As  a result,  we  have  shown 

that  £ = 0 and  n is  a monomorphism. 

It  must  be  clear  from  the  very  definition  of  it  that  any  h in  Imm 

has  the  property  claimed  in  the  proposition.  To  complete  the  proof  let 

Z+xZ" 

us  assume  that  h in  (Kpxm)  X X has  the  property.  Next  we  write  h as 

n z,+xZC 

(3.1.8)  h = (h^,  h2,  ...,  h^)  , where  Iv  e (Kp)  x 

For  a fixed  element  1 of  Z^  the  partial  function  h-|  is  given  by 

(3.1.9)  h]  = (h^.,  1),  h2(.,  1),  ...,  hm(.,  1)), 

Z+ 

where  h. (.,  1 ) e (Kp)  \ 

Let  us  denote  by  H the  K-space  generated  by  the  h-j  1 s ; that  is 


Since  H is  finite  dimensional  by  assumption  so  is  the  K-space  spanned  by 
the  elementary  columns  of  h-|  ; that  is 

Hc  :=  <!V*’  x-1)’  •••»  hm(*’  x_1)  > n1(*>  x_2)> 


h (■ 
m 


\-2) 
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is  finite  dimensional.  Say  dim  H = n,  then  there  exists  a basis 

Z 

(f,  , f9,  ....  f } for  H , where  f.  e(K^)  \ Therefore,  for  each  1 e Z" 
i c.  n ^ l a. 

and  each  i from  {1,  2,  m},  there  exist  scalars  g^(l),  g2-j(l),  •••. 

gni(l)  such  that 


M*.  D = 2 f g (1) 

j = l J J 


By  using  (3.1.9),  we  have 


■i  ‘•j:1  'j 


which  can  be  expressed  as 


h-|  [f ^ > f 2 » • • • > f p 1 


; e 
j=i 

fj  9j20). 

. . . , I f 

j=l 

ind) 

g12^  ^ 

•••  glm 

21^ 

g220 ) 

• 

• 

•**  g2m 

• 

• 

• 

nl^ 

gn2^  ^ 

g 

3nm 

J 


(3.2.10) 

Finally,  define 

g^i)  :=  Cgil(i);  gi20);  •••  9im(i ) 3 for  i = 1,  2,  ...,  n 
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Than  (3.1.10)  can  be  rewritten  as 


(3.1.11) 


b]  t-^i » f 2 ’ • • • » ^2} 


g2(i ) 


2 f i 9h  (1 ) 
i=l  1 1 


gnO) 


Hence,  by  choosing  coefficients  gji(l)  for  each  1 e z‘,  we  obtain 
elements  gl5  g2,  ...,  gn  of  (KJ  x such  that  (3.1.11)  holds.  This  means 


n 

h = ti(  E f 0 g ) 
i =1  1 1 


□ 


We  should  note  that  injectivity  of  n was  pointed  out  by  FI  i ess  [1982], 
although  a proof  was  not  given. 


(3.1.12)  PROPOSITION.  Let_  m and  p be  fixed  positive  integers,  and 
K’  Z\  be  the  proper  subsets  of  Z defined  in  (3. 1.2-3).  Then  as 
K-vector  spaces 

Z\ 

(i)  (O  is  isomorphic  to  Kp[[t ] ] , 

Z" 

(ii)  (<m)  is  isomorphic  to  K ^[[x'l  1 , 

Z+xZ‘ 

(iii)  (K^xin)  x x is  isomorphic  to  |<pxm[[t  t]] 
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(iv)  KP[[t]]aKm[[x]]  is  canonically  isomorphic  to  the  sub 
K-space  of  KPxm  [[t,  x]]  consisting  of  the  following  power 
seri es 

(3.1.13)  E a , ( t ) b . ( x ) , a (t)  e KP[[t]],  b.(x)  e K [[x]] 

■j  =1  I 1 Ml 

and  n is  a finite  positive  integer. 


PROOF:  (i)  - (iii)  are  rather  obvious  while  (iv)  follows  directly  from 

proposition  (3.1.6)  and  from  (i)  - (iii). 

□ 

Any  element  of  Kp[[t]]  ^[[x]],  i.e.,  of  the  form  (3.1.13), 

will  be  referred  to  as  a (generalized)  representati ve  series  (this 
terminology  is  due  to  FLIESS  [1982,1983]). 


00  00 


(3.1.14)  DEFINITION:  Given  any  formal  power  series  W = E E 

W.jj  t^  V jn_  KPx,n  [[t,  x]].  The  characteri  sti  c (or  representati  ve) 


matrix  C(W)  associated  with  W is  the  infinite  matrix  given  by 


(3.1.15) 


C(W)  = 


11 

W12 

W13 

21 

W22 

W23 

31 

W32 

W33 
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Furthermore,  the  rank  of  C(W)  is  defined  to  be 

(i ) finite,  equal  to  n,  if  there  is  a non-zero  minor  M _of_  C(W) 
of  order  n,  and  any  other  minor  of  C(W)  of  order  (n+1)  i s 
zero; 

( i i ) infinite,  otherwise. 

Let  R.j(C.j)  denote  the  itln-block  row  (column)  of  the  characteristic 
matrix  C(W);  that  is,  for  each  i e Z+. 


R.  : = 
1 

t“il-  “ 

i 2’  • 

..  ] 

<5  : 

■ CMIi  • 

W2i  ’ 

. ...]^),  T denotes  the 

transpose 

operati on . 

Let  R(C)  be 

the  set 

of 

all  finite  linear  combinations 

Z r.  R. 

l l 
i 

riCi  = 

(E  r.C.),  with 

r.  e K 

i 

and 

r.  R.  = [r.  W. . , r.  W , . . .] 
it  ill  l l 2 

( 

[pi  Wli  » riW2i  ’ " 

UT). 

Wi  th 

componentwise  addition 

and 

seal ar 

multiplication  defined 

by 

rRi  = [rWn,  rWi2, 

• ] 

(r^  = 

[rwj. , rW^  , ...]),  it  is  very  easy  to  see  that  R(C)  becomes  a K-vector 
space.  We  shall  say  that  R is  the  K-vactor  space  spanned  by  the 
(infinite)  block  rows  of  C(W)  while  C is  the  K-vector  space  spanned  by 
the  block  columns  of  C(W) . 

For  each  i ,j  in  Z+  we  observe  that  the  itln-block  row  R^  = [W^, 
Wi2>  •••]  and  the  jth-block  column  Cj  = [W^  , W^  , ...]  of  C(W)  can  be 
seen  respectively  as  the  following  formal  power  series, 
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(3.1.16)  W (1)  :=  Z e Kpxm[[x]]  , 

T j=l 

(3.1.17)  W (j)  :=  E W..  t1'1  e Kpxm  [[t]]  . 

t i=l 

Furthermore,  by  letting  Q(x) (Q(t ) ) denote  the  subspace  of  Kpxm[[T]] 

(Kpxm[[t]]) 

consisting  of  all  finite  linear  combination  of  the  form 

oo 

Z r.W^(i)  (z  r Wt(j))  with  r.  eK  and  r.WT(i)  = Z (r.W..)^"1 
J j — 1 

oo  i 1 

(riWt(j)  = i Z (r.W.  )t  ),  it  is  not  hard  to  see  that  Q(t)(Q(t)) 

J J 1 J 

becomes  a K-vector  space  with  respect  to  componentwise  addition  and 
scalar  multiplication  as  the  ones  defined  in  Kpxm[[-c]]  (KPxm[[t]]). 

It  is  a small  matter  now  to  show  that  as  K-vector  spaces  "R  is 
isomorphic  to  Q(t)"  while  "C  is  i somorphic  to  Q(t)11 . 

oo  oo 

(3.1.18)  PROPOSITION:  Given  a formal  power  series  W = Z Z 

W-jjt1"1^'1  1H  Kpxm[[t,  x]],  the  fol  lowing  statements  are  equivalent. 

( i ) W is  representati ve , 

( i i ) R as  a K-vector  space  is  finite-dimensional, 

( i i i ) C as  a K-vector  space  is  finite-dimensional. 

_PR00F:  The  scalar  case  (p=m=l)  was  shown  in  FLIESS  [1982],  and  we  shall 
prove  the  general  case  using  a different  line  of  arguments  than  that 
given  by  FLIESS  [1982]. 

First  we  show  that  (i)  is  equivalent  to  (iii).  Recall  that  we  have 
shown  that  Cg  is  isomorphic  to  Q(t).  By  proposition  (3.1.12)  together 
with  proposition  (3.1.6)  we  have  that  the  K-l inear  mapping 
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it  : K1 


[[t]] 


K [[x]]  -*■  K 


pxm 


: E a, I 


[[t,x]'i=1  i "i 


* E a,  b . 


i =1 


i i 


is  injective,  and  we  have  called  any  element  in  Iimi  a representative 
series.  Furthermore,  a We  K^xm[[t,  x]]  is  in  Imu  if  and  only  if  the 
K-l inear  subspace  of  KPxm[[t]]  generated  by  the  power  series  Wt(j)  = 

co  . 

E W..t1-  with  j ranging  over  Z+  is  finite-dimensional  (this  is  not 


i =1 


ij 


more  than  a rephrasing  of  the  last  part  of  proposition  (3.1.6)).  Next, 
we  use  the  definition  of  Q(t)  to  conclude  that  W e Imu,  i.e.,  it  is 
representati ve,  if  and  only  if  Q(t)  is  finite  dimensional.  And  since 
C ~ Q(t),  it  follows  that  (i)  - ( i i i ) . 

On  the  other  hand,  we  have  that  a given  formal  power  series 


" “ "ii0 

i=l  j*l  1J 

in  KPxm[[t,  x]]  is  representati ve  if,  and  only  if, 

WT  :=  E E WT.  ti_1xj_1 

1-1  j-1  1J 

in  KmxP[[t,  x]]  is  representati ve  (the  proof  of  this  is  rather  obvious 
so  we  omit  it).  And  it  is  not  hard  to  see  that  C(W^)  = C^(W); 
therefore,  the  K-vector  space  spanned  by  the  block  columns  of  C(WT), 
cj,  coincides  with  the  K-vector  space  spanned  by  the  block  rows  of 
C(W),  R.  Then  by  using  the  first  part  of  this  proposition,  we  conclude 
that  (i)  and  (ii)  are  equivalent. 

□ 
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Now,  we  are  ready  to  prove  the  next  result. 

00  00  ill 

(3.1.191  THEOREM:  A formal  power  series  W = E E W^t1  -cJ  jn_ 

i=l  j=i  ^ 

K^xm[[t,  t]]  is  representati ve  if  and  only  if  the  rank  of  its 
characteristic  matrix  C(W)  is  finite. 

PROOF:  Let  X,r,(X,C,)  be  the  K-l  inear  space  spanned  by  the  elementary  rows 

w w 

(columns)  of  C(W).  Then  it  is  a well-known  fact  that  the  following 

statements  are  equivalent. 

(i ) rank  C(W)  = n < ® 

(ii)  xj  is  finite-dimensional 

(iii)  xP.  is  finite-dimensional. 

But  recall  that  the  K-vector  space  R is  finite-dimensional  if  and  only 

if  x,r;  is  finite-dimensional.  Therefore,  by  proposition  (3.1.18)  and 

w 

(i)  - (iii)  above,  it  follows  that  W is  representati  ve  if  and  only  if 
rank  C(W)  < j— j 

oo  oo  . 1 

(3.1.20)  COROLLARY:  Let  W = E E W, .t  xJ  in  KPxn[[t,  t]]  be  a 

i =1  j=l 

representati  ve  series,  i.e.,  rank  C(W)  = n < °°.  Then,  there  is  a 
decomposition  of  W of  length  n , that  is, 

n 

W = E a (t)b  (t)  , 

v vv 
v=l 


where  av(t)  e <P[[t ]] , by(t)  e ^[[xj].  Furthermore,  for  any  other 
decomposition  of  W,  say 
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n 

W = Z a'  (t)b'  (t)  , 

v=l 


with  a^(t)  e Kp[[t]],  b^(-c)  e ^[[-tj],  we  have  n1  > n. 


PROOF : Assume  that  rank  C(W)  = n < <*>.  Then,  it  is  a well-known  fact 

that  X,r,  the  K-vector  space  generated  by  the  elementary  rows  of  C(W), 
w 


has  dimension  n.  That  means  that  there  exists  a basis  r 

,th 


k(  1) * rk(2)  ’ 


rk^nj  for  X^,  where  rk  denotes  the  k -el ementary  row  of  C(W). 
Hence,  for  each  j e Z+  there  exists  scalars  in  K, 

such  that  the  jth-el ementary  row  of  C(W)  can  be  expressed  uniquely  as 


(3.1.21) 


r = z «(J>P 
j =1  P k(p) 


Next,  write  the  it!l-block  row  of  C(W)  as 


jin 

“n 

“l2 

u(il)l 

• * * “lm  i 

u(12) 

“11 

u(12) 

22 

Ji2) 

...  “lm 

II 

J11) 

“21 

• 

JiD 

“22 

* ’ ’ “2m  | 

u(12) 

“21 

Ji2) 

“21 

• 

(.( 1 2) 
. . . o)2m 

1 1 ) 
V 

•(ii) 

“p2 

• | 

* (i  1) 

...  0)  1 

pm  i 
| 

‘(i2) 

“pi 

,‘(i2) 

“p2 

•(i2) 

• • • OJ  • • • 

pm 

J 

(3.1.22) 


8y  using  (3.1.21),  we  have  that  the  vt!l-el ementary  row  r^  of  R^  can  be 
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written  as 


(3.1.23) 


r = z a(iv)  r 
iv  \i  k(p) 


v - 1,  2,  . . . j p 


Next,  for  each  p,  e {1,  2,  ...,  n}  write  r^  ^ as 


( 3. 1 .24)  rk^j  - CqJ(^),  qj^)>  \^y  •••]  Wlth  ^k(fx)  e Km  * 


Hence,  by  putting  (3.1.24)  into  (3.1.23)  we  get 


riv  = CJl  u=i  ai1V)qk(p)’  f°r  1 £ 1 ' 


V £ {1,  2,  . . . , p}  . 


And  by  substituting  (3.1.25)  in  (3.1.22),  it  is  easy  to  see  that 


Wij 


for  each  i ,j  e Z 


Z «(11)  gj 


S «(12)  aj 

A' 


Z . 

1.-1  11  k(|l) 


i e l\  and  each  \i  e {1,  2,  ....  n}  the  vector  a^'  ^ 


Define  for  each 
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in  KP  by 


,(i) 


(11) 

i 

4 

(12) 


‘(ip) 

a 

P 


( recal  1 that  oc^  ' e K) 

r* 


Then  we  can  write  W—  as 


n 


. . = £ qJw  > 

1J  u=l  P 


00  00 


As  a result,  the  power  series  W = £ £ W.  .t'*  ^ ^ can  be  expressed 

i =1  j=l  J 


as 


00  00  fl 


W = £ S ( £ K 1 qJk((i))t  * 


(i)  J ui-ij-i 


i=l  j = l 4=1 


which  can  be  written,  after  an  interchange  of  summations,  as 


W = £ ( £ a^1  )t1  _1)  ( £ qj(  v-c^1) 

4=1  i =1  p j = l 


= £ a (t)b  (x) 

1 4 4 

4=1 


00 

a (t)  :=  £ af/V"1  e KP[[t]] 

P i =1  u 

oo 

b^(x)  :=  £^  qj^  e Kffl[[x]]  (see  3.1.24)) 


where 
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We  have  thus  shown  that  in  fact  W can  be  decomposed  into  n terms. 
The  last  part  of  the  corollary  follows  from  the  fact  that  a 
decomposition  of  W with  n'  < n would  imply  that  rank  C(W)  = n‘  < n, 
which  clearly  is  a contradiction.  (To  see  this,  just  reverse  the  steps 
given  in  the  proof  above.) 

□ 


3.2  Local  Realizability  Criterion 
For  a given  integer  X , we  defined  by  CP  the  proper  subset  of  CP 

A. 

given  by 


CP,  ={(k,leZxZ:k>\>l} 

CP 

Denote  by  [KPxm]  ^ the  K-vactor  space  consisting  of  all  functions  with 
domain  CP^,  <ind  with  values  in  the  K-vector  space  kPxm. 

Consider  a linear  input/output  map  f,.  : 6in  -►  Bp  with  unit  pulse 

response  W(k,  1),  (k,  1)  e CP.  And  for  each  fixed  integer  X define  the 

following  mapping 

CP 

(3.2.1)  <|,  : [Kpxm]  -y  Kpxm[[t , t]]  : W •>  Z E W.  . (x)t1  ^t^-1 

i =1  j=l  1J 

where 


w-jj(M  W(\+i-l,  X-j)  for  all  i,j  e Z+ 


(3.2.2) 
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(3.2.3)  PROPOSITION:  The  mapping  <k  : [Kpxm]  X -►  Kpxm  [[t,  t]] 

A. 

defined  by  (3.2.1)  i s a K-linear  isomorphism.  Therefore,  as  K-vector 
spaces 


CP 

[Kpxm]  X ~ Kpxm[[t,  t]]  . 

PROOF:  That  is  a linear  and  one-to-one  can  be  seen  directly  from 

A. 

the  definition  of  addition  and  scalar  multiplication  in  the  K-vector 
CP 

spaces  [KPxm]  and  KPxm[[t,  t]].  Let  us  show  that  <|»  is  onto.  For 

A. 

any  element 


Z fl, • (\)ti“1T^_1 

i » j > 1 1J 

in  KPxm  [ [t , t]]  define 

a(k’  '>  ;=  qk-x,-i+k-i  for  aH  (k-  11  E cfV 

CP 

Clearly  W e [KPxm]  \ and  it  is  such  that 

\(W)  = £ Qij(\)\\j. 
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The  above  result  although  simple  in  nature  will  bring  important 
consequences  in  our  work,  since  it  will  allow  us  to  study 

factori zabi 1 i ty  of  unit-pulse  response  matrices  W over  CP  by  using 

A. 

the  theory  of  representati ve  power  series. 

CP, 

(3.2.4)  PROPOSITION:  Let_  W e [Kpxm]  K be  such  that  W(k,  1)  = 

f(k)g(l)  for  all  (k,  1)  in  CP^,  where  f : (x,  x+1,  ...}  -►  Kp  and 
g : { ...,  X-2,  X-l}  -►  K^.  Then  <p  (W)  is  a representati  ve  formal 

power  series. 


PROOF : By  definition 

hypothesis,  we  have  that 


cb  (W)  = E W(X+i  -1,  X-j)t1_1Tj'1; 


By 


W(X+i-l,  X-j)  = f (X+i -1 ) g (X-j ) for  i , j e Z+ 


Hence 


(|\(W)  = E f(X+i-l)g(X-j)t1“1Tj"1 
X i,j>l 


CO  00 

= ( E f (x+i -l)t1_1)(  E g(x-j)Tj_1)  . 
i=l  j=l 


That  is 


<PX(W)  = ax(t)bx(t ) 
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where 

co 

a (t)  = S f(X+l-l)ti_1  e KP[ [ t ] ] ; 
X i=l 


CO 

b (t)  = E g(X-j)x^-1  e K [[x  . 

X j=l  m 

Therefore,  <j>  (W)  is  representative  by  definition  (see  (3.1.13)). 

A. 

□ 

Basically,  the  above  proposition  says  that  if  W(*,  •)  is 
separable  over  CP^,  then  c|>  (W)  is  representati ve.  It  is  natural  to 
see  whether  or  not  the  reversed  implication  is  also  true. 


(3.2.5)  PROPOSITION:  Let_  a(t)  = Z a.(X)ti_1  eKp[[t]],  and  b(x)  = 

00  i =1  1 

Z bj(x)x^-1  e Km[[x]],  then  we  have  that 


(i)  W :=  a(t)b(x)  e Kpxm[[t,  x]]  , 


(ii)  <P^1(W)(k,  1)  = f(k)g(l ) for  all  (k,  1)  e CP^ 


where 


f : {X,  X+l,  ...}  + KP  : k + ak_x+1(x) 


0 : {...,  X-2,  X-l}  > K|T1  : 1 -+  bx  ^ (X) 


PROOF:  (i)  is  clear  since  a(t)b(x)  = z a . (X)b . (X)t’ "V"1  e 

i >j=l  1 J 
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KPxm[[t,  t]].  To  show  ( i i ) , observe  that 

4,  (fg)  = E E f (X+i-l)g(X-j)t1“i-uJ'  (see  (3.2.1)) 
x i=l  j=l 

CO  oo  , . 

= E E a.  (\)b . (x)t1  (by  definition  of  f and  g) 

i =1  j = l 1 J 


= ( E a.(\)t1"1)(  E b.(X)xj_1) 
i =1  1 j=l  J 

= a(t)b(x) 

But  recall  that  <k  is  a vector  isomorphism,  then 

A. 

[(V“1(a(t)b(x))](k,  1)  = f(k)g(l ) for  all  (k,  1)  e CP^ 

□ 

It  is  important  to  realize  that  <|>  is  not_  a ring  homomorphism  in 
the  case  where  p = m.  To  see  that,  let  p=m=l  and  consider  the  functions 
f and  g defined  in  proposition  (3. 2.6).  Then 

00  00  <=  . 00  . 

<k(f)  = ( E a.(X)t1_1)(  E XJ_1)  ; 41.(3)  = ( s t1_i)(  51  or3'  ). 

x i=l  1 j=l  X i=l  J=1  J 


Clearly, 
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4\(fg)  = 2 2 a.(\)b.(x)t1"1xj‘1  * 4,  (fU  (g)  . 

i=l  j = l "■  "■ 

CP 

(3.2.6)  THEOREM:  Let  W e [Kpxm]  \ Then  W ( k , 1 ) = e f (k)g^s^  (1 ) 

L°-C ill  (k>  1)  e CP  for  some  f^  : \+l,  ...}  -►  kP  , 

: {...,  \-2,  \-l}  ■+  if,  and  only  if 

n 

<k(W)  = e a (t)b  (x) 

K s=l  s s 

for  some  a (t)  e KP[[t]]  and  b (x)  e K [[x]]. 

S S / mLL  JJ 


•HOOF:  First,  let  us  assume  that  W can  be  written  as 

W(k,  1)  = e f(s)(k)g(s)(l)  for  all  (k,  1)  e CP, 
s=l  *■ 

Then  by  definition  of  '<(» 

H(W)  = e W(\+i  -1,  e ( E f(s)(X+i-l)g(s)(\-j))ti“1x'j“1. 

i ,j >1  s= 1 

Next  define 


a (t)  = E f(s)(\+i-l)t1_1e  KP[[t]] ; 
i = l 


bs(x) 

to  obtain 


2 g(s)(^-j)Tj_1e  K [[x]] 
j = 1 111 


n 

UW>  = E MOMx) 

s=l  s s 
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Conversely,  assume  that 
n 

\(W)  = s^as(t)bs(x)  with  a$(t)  e Kp[[t]],  d$(t)  e KJCt]]  . 
Because  <j>^  is  also  a K-l  inear  homomorphism,  we  get 

W(k » = \1(^(W))(k,  1)  = cj,’^  z a$(t)bs(T))  = 

n -1 

' E \ (as(t)b  (x)) 
s=l  K s s 

£ f^(k)9^0)  for  all  (k,  1)  e CP^.  (By  prop.  (3.2.5)) 

□ 

Next,  we  relate  the  above  results  with  the  real  i zabi  1 i ty  of  fw  : 
B1"  * Bp  on  CP^ . 

(3.2.7)  COROLLARY : AnJ/o  map  fy:  B™  •>  Bp  with  unit-pulse  response 

w(*>  *)  1§.  realizable  on  CP^  if  and  only  if  ^(w)  is  a 


representati ve  power  series. 
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PROOF : By  proposition  (2.3.38)  fw  is  realizable  on  CP^  if,  and  only 

if  there  exist  matrix  functions 


P^H  : (X,  X+l,  ..•}  -»•  Kpxn 


, n a fixed  positive  integer 


Qx(0  : X-2,  X-l}  * Knxm 


such  that 


W(k,  1)  = Px(k)Qx(l)  for  all  (k,  1)  e CPX* 


Next,  we  write  P and  Q as 

A.  A. 


where 


\ ■ ^2> 


,(l) 


p<"h 


.(2) 


-i"' 

w > 


Px(s)  : (X,  X+l , . . .}  -*•  Kp ; 


q[s)  : {...,  X-2,  X-l}  + 
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Therefore 

(3.2.8)  W(k,l)  = z p|S^(k)q^(l)  for  all  (k,  1 ) e CP  , 

S=  1 A. 

CP 

and  by  theorem  (3.2.6),  any  W e [K^"]  * can  be  expressed  as  in 

(3.2.8)  if  and  only  if  ^(W)  = J a$(t)bs(x)  with  a$(t)  e K»[[t]], 

bs(T)  e "^at  ^ anc*  or,ly  if  <I^(W)  is  representative. 

□ 


(3.2.9)  THEOREM:  An  input/output  map  f;j  : B?  - is  realizable  on  CP-, 

— - and  ogiy  lf>  the  rank  of  the  character! stic  matrix  associated  with 

VW)  = E V'1  Is  finite.  That  is.  if  and  only  if 

i,j>1  - 

WU,\-1)  W(\,X-2)  W(\,\-3) 

W(\+l ,\-l)  W(\+l ,\-2)  W(\+l ,\-3) 

\ . __ 

W(\+2,X-1)  W(\+2,\-2)  W(X+2,\-3) 

• . 

: 

\ 

has  finite  rank.  ^ 

PROOF:  From  corollary  (3.2.7)  f„  is  realizable  on  CP^  if,  and  only 

if,  <I»X(W)  is  a representative  series.  On  the  other  hand,  by  theorem 

(3.1.19)  ^(W)  is  a representative  power  series  if,  and  only  if, 

CX(W)  has  finite  rank. 

□ 

So  far,  we  have  found  a realizability  criteria  for  fy  on  each  piece 
CP^.  Then  the  most  natural  thing  to  do  is  to  link  real i zabi 1 ity  on  each 
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CPX  to  find  necessary  and  sufficient  conditions  for  f^  to  be  realizable 
on  CP. 

(3.2.10)  THEOREM:  An  i/o  map  f,^  : R™  -*■  with  unit-pulse  response 

matrix  W(  • , •)  is  realizable  on  the  causal  half-plane  CP  if,  and  only 
if  there  exists  a finite  positive  integer  n such  that 

(3.2.11)  rank  C^(W)  < n for  each  X e Z. 

In  fact,  if  we  let  n,  :=  rank  C^(W),  then  n :=  maximum  (n,  : X e Z} 

A.  A. 

is  the  dimension  of  a minimal  realization  Z = (0,  E,  H)  of  f^  ^n_  CP, 
and  n is  the  smallest  positive  integer  for  which  (3.2.11)  is  satisfied. 

PROOF : (Necessity).  Suppose  fw  has  an  n-dimensional  realization  Z = 

(D,  E,  H)  on  CP.  Then  by  definition 

W(k,  1)  = H(k)<j>(k,  1 + 1) E(1  +1)  , for  all  (k,  1)  e CP. 

For  each  X e Z,  define 

P.  (k)  = H(k)<t>(k,  x+1 ) , k > X , 

A. 


Qx(l)  = <)>(X,  1 + 1)E(1  + 1)  , X > 1 . 
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Then 


W(k,  1)  = Px(k)Qx(l)  , (k,  1)  e CP^  . 

Next,  write  P and  Q as  we  did  in  the  proof  of  corollary  (3.2.7)  to 

A.  A. 

express  W as 


W(k,  1) 


n 

Z 

S = 1 


p(s)(k)q(s>(l)  , 


for  all  (k,  1)  e CP. 


Hence,  <|>  (W)  is  representati ve  and  by  corollary  (3.1.20)  we  have  that 


rank  C^(W)  = n < n 

A. 


for  each  X e Z. 


Conversely,  let  us  assume  that  for  each  X e Z,  rank  C^(W)  < n, 
where  n is  finite  positive  integer  independent  of  X.  Let  X^  be  a fixed 
integer,  then  by  hypothesis 

X1 

rank  C (W)  = n^  < n 


By  corollary 
that  is, 


(3.1.20)  there  is  a decomposition  <|>  (W)  in  ni  elements; 

X1 


1 

<k  (w)  = Z a (t)b  (t) 
X1  s=l  S S 


as(t)  e Kp[[t]],  bs(x)  e KJM]. 
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By  theorem  (3.2.6) 
nl 

W(k,l)  = E f{s)(k)g{s)(l),  for  all  (k,  1)  e CP,  . 
s=l  *1  x\ 

Define 


{fU).f(2).  . f(nl> 

Ki  h xi 


,(D 


.(2) 


(nx) 


can  take 


Introducing  (n-n^)  superfluous  states  we  can  obtain  an 

ll 


n -dimensional  realization  E = (D,  E,  H)  of  fw  on  CP^  . In  fact,  we 


— - 

I 0 

E 

nl 

, E = 

1 

0 I,  . 

( n-n  x ) 

0 

..  ^ 

- — ■ 

, H = [H15  U]  , 


where  E^k)  = .Q,  (k-1),  for  k < \ and  EL(k)  = 0 for  k > H^K) 
Px  (k)  for  k > \ and  H^k)  = 0 for  k < 
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We  have  thus  shown  that  for  each  X^  in  Z is  realizable  on  CP 
by  an  n-dimensional  system  E = (13,  E,  H),  and  n is  independent  of  X. 
And  finally  by  using  proposition  (2.3.42),  we  conclude  that  f,^  is 
realizable  on  CP.  The  last  statement  of  the  theorem  follows  from  the 
definition  of  n,  and  from  the  proof  above.  i—| 


(3.2.12)  DEFINITION:  Given  a linear  i/o  map  f^  : B™  -*■  with  unit 
pulse  response  matrix  W(k,  1),  (k,  1)  e CP,  define  as  its 
(generalized)  Hankel  matrix  Bu  the  infinite  matrix  given  by 


(3.2.13)  Bw(k) 


Wn(k)  W19(k)  W.,(k) 


ir 
W21(k) 

W3i(k) 


12 
W22(k) 


13' 

w2300 


W32(k)  W^^(k) 


33' 


, for  each  k e Z 


where 


(3.2.14)  W_(k)  :=  W(k+i-l,  k-j)  for  each  i , j e Z , and  each  k e Z. 


Now,  let  k be  a fixed  arbitrary  integer.  It  is  strai ghtforward  to 

k 

see  that  the  characteristic  matrix  C (W)  associated  with 


CD  CD 


4».  (W)  = EE  W(k+i  -1,  k-jjt1"1^"1 
K 1=1  j=l 
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in  theorem  (3.2.9)  coincides  with  B (k).  Therefore,  theorem  (3.2.10) 
can  be  stated  as  follows. 

(3.2.15)  THEOREM:  An  input/output  map  f : B+  -*■  with  unit-pulse 

response  W(»,  •)  is  realizable  (on  the  causal-half  plane  CP)  if  and 
only  if  there  exists  a finite  positive  integer  n such  that 

(3.2.16)  rank  B^(k)  < n for  all  k e Z 

Furthermore,  the  smallest  positive  integer  n for  which  (3.2.16)  holds  is 
the  dimension  of  a minimal  realization. 

This  criteria  for  realizability  can  be  considered  as  the  discrete 
time  counterpart  of  theorem  (2.2.12)  in  the  sense  that  it  is  a one- 
variable  criterion,  and  that  it  requires  the  computation  of  the  rank  of 
a collection  of  infinite  matrices,  B^,  indexed  by  Z.  However,  there  is 
a big  difference  because  in  (3.2.16)  equality  may  not  be  attained  in 
general  as  we  now  show. 


(3.2.7)  EXAMPLE:  Consider  f : B+  ■*  B+  whose  unit-pulse  response  is 

given  by 


(3.2.18) 


1,  for 


w(k,  1 ) = < 


5,  6,  and  1 = 3,  4, 


0,  otherwise. 
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Note  that 

w(k}  1)  - [A(k-5)  + A(k-6)][A(1 -3)  + A(l-4)]  for  all  (k,  1)  e CP. 

Because  w(«,  •)  is  separable,  it  must  be  clear  that  fw  is  realizable 
on  CP. 

In  this  case 


B (k) 


w(k,  k-1) 
w(k+l,  k-1) 
w(k+2,  k-1) 


It  is  very  simple  to  see  that 


w(k , k-2) 
w(k+l,  k-2) 
w(k+2,  k-2) 


k e Z. 


8w(k)  =0  for  all  k e Z - (4,  5,  6}, 


while 


“ * 

— 

0 0 ... 

1 0 ... 

1 1 0 ... 
1 1 0 ... 

Olio  ..." 
0000... 

6 (4)  = 
w ' ' 

1 0 ... 

0 0 

• • 

• • 

- V5>  = 

0 0 0 ... 

• • • 

♦ • • 

♦ • « 

’ V6)  = 

0 0 0 0 ... 

• • • • 

• • • • 

• • • • 

- J 
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Thus, 


rank  B (k) 


= < 


1, 


0, 


k = 4,  5,  6 
otherwi se 


and  we  observe  that  fw  is  realizable  (by  theorem  (3.2.15));  however 
there  is  no  positive  integer  n such  that  rank  Bw(k)  = n for  each  k e Z 


CHAPTER  FOUR 

GLOBAL  REALIZATION  CRITERIA 

It  was  seen  in  Chapter  Two  that  the  realizability  criteria  for 
time-varying  real  analytic  input/output  maps  can  be  viewed  as 
generalizations  of  criteria  for  time-invariant  response  maps.  As  an 
example,  from  theorem  (2.1.9)  we  have  that  a constant  i/o  map  fy  = {Wp 
W2,  ...}  is  realizable  if  and  only  if  the  formal  power  series  W(z_1)  = 

E W.z_i  in  Kpxm[[z_1]]  is  recurrent  (see  definition  (2.1.8)).  And 
i =1  1 

it  was  shown  in  KAMEN  [1979]  that  a generalization  of  this  condition 
gives  us  a realizability  criterion  for  analytic  i/o  maps  fy  : 
Cm(J)  * CP(J). 

In  this  part  of  the  work,  we  shall  show  that  for  discrete  time- 
varying  response  maps,  it  is  possible  to  accomplish  also  the  above 
mentioned  generalization.  In  point  of  fact  our  results  are  similar  to 
the  ones  obtained  by  KAMEN  [1979]  for  the  analytic  case.  However,  it  is 
worthwhile  to  point  out  that  due  to  the  differences  in  structure  of  the 
rings  A(J)  and  B,  e.g.,  the  former  is  a 3ezout  domain  while  the  latter 
is  not  even  an  integral  domain,  there  is  no  reason  why  we  should  expect 
that  those  criteria  for  realizability  in  the  analytic  framework  carry 
over  the  discrete-time  one.  On  the  other  hand,  discrete  time-varying 
systems  and  analytic  systems  have  indeed  something  in  common,  and  that 
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is  that  both  have  an  associated  pseudo-linear  transformation  (see 
equations  (2.2.23)  and  (2.3.28)).  This  fact  is  a good  reason  for  the 
existing  similarity  between  the  two  mentioned  frameworks. 

k 

Consider  a linear  i/o  map  f,,  : B+  -*•  : u -*•  f^(u)  : k * £ 

1 = -°° 

W(k,  l)u(l)  (recall  that  W is  the  unit-pulse  response  matrix  of  fw) . 
For  each  fixed  positive  integers  i , j , associate  with  f^  the  following 
matrix. 

(4.1)  W..(k)  :=  W(k+i-l,  k-j)  , keZ. 

^ J 


Clearly,  each  is  a pxm  matrix  over  the  ring  B.  It  is  very  easy  to 
show  that  fw  is  realizable  (on  CP  = causal  half-plane)  by  a time- 
invariant  system  E = (D,  E,  H)  (that  is,  D,  E,  H are  constant 

matrices)  if,  and  only  if 

(i)  the  matrices  W—  are  constant  over  Z, 

(4.2)  (ii)  W ^ ^(k)  = W.j  ^(k)  = H0^"^E  for  all  i e Z+,  and  all  k e Z. 

We  next  give  necessary  and  sufficient  conditions  for  realizability 
of  f^  which  reduce  to  (4.2)  when  there  is  a time-invariant  realization. 

(4.3)  LEMMA:  Given  an  n-dimensi onal  system  E = (D,  E,  H)  over  B,  1 et 

W (•,  •)  denote  its  pulse-response  matrix,  that  is,  W2(k,  1)  = 
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H( k ) 4>s( k , 1+1)£(1+1)  for  al  1 (k,  1)  e CP.  Then  for  each  fixed  positive 
i ntegers  i ,j 


(Ws)ij  = (Si’1HT)T(Sj“1E)  , 


where 


(i)  (Wz).j(k)  :=  Ws(k+i-l,  k-j)  , k e Z 

^ i a 

(ii)  S1"1  is  the  (i-l)-fold  composition  of  S as  defined  by 
(2.3.31),  and_  SJ_1  i s the  (,j-l)-fo1d  composition  of  S _as 
given  by  (2.3.28). 

PROOF : By  using  (2.3.31),  it  can  be  shown  by  induction  on  i that 

(4.4)  (S1'1HT)(k)  = H(k+i -l)D(k+i -l)D(k+i -2)  ...  D(k+2)D(k+l) 

for  each  i e Z+,  and  each  k e Z. 

From  the  definition  of  the  state-transition  matrix  <)>  (•,  •)  of  D 

(see  (2.3.5)),  we  observe  that  (4.4)  can  be  written  as 

(4.5)  (S1'1HT)T(k)  = H(k+1-l)4>s(k+i-l,  k)  , i e Z+  , k e Z. 

In  similar  manner,  by  using  (2.3.28),  we  can  show  that 

(SJ_1E)  (k)  = <|>s(k,  k-j+l)E(k-j+l) 


(4.6) 
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for  each  j e Z+,  and  each  k e Z. 

Next  combine  (4.5)  and  (4.6)  to  get 

(4.7)  (S1_1HT)T(k)(Sj_1E)(k)  = H(k+i -l,k)<t>s(k,k-j  + l)E(k-j  + l) 

for  i , j , e Z+,  k e Z. 

Finally,  use  the  semigroup  property  of  <t>  (that  is  <}>( k , 1 ) 

Lt  1 

<t>Ol5  1)  = 4>(k,  1)  for  k > 1 ^ > 1 ) and  the  definition  of  W to 
obtai n 

(S1"1HT)T(Sj_1E)  = (Ws)ij  , i , j e Z+. 


Using  lemma  (4.3)  we  get  the  following  necessary  and  sufficient 
conditions  for  realizability  in  terms  of  the  W^j  given  by  (4.1). 

(4.8)  PROPOSITION:  Given  a response  map  f,,:  8™  -*  with  unit-pulse 

response  matrix  W( • , •)  and  an  n-dimensi onal  system  Z = (D,  E,  H)  over 
B,  the  following  statements  are  equivalent: 

(i)  Z = (D,  E,  H)  realizes  fw, 

(ii)  Wij  = (S1'1HT)T(sj_1E)  , for  each  i ,j  e Z+, 

(iii)  = H(Sj-1E)  , for  each  j e z+5 
^ = (Si-1H^)  E , for  each  i e Z+. 


(iv) 
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PROOF : That  (i)  implies  (ii)  follows  directly  from  the  definition  of 

realization  (W  = W^,)  and  from  lemma  (4.3).  Also,  that  (ii)  implies 
(iii)  and  (iv)  is  rather  clear  since  S°  = S°  = identity  operator.  So, 
we  start  by  showing  that  (ii)  implies  (i). 

Note  that  at  each  (k,  1)  e CP,  W(«,  •)  can  be  expressed  as 


(4.9)  H(k,  1)  = E W (k)A(k-l-j) 

j = l J 


where 


A(k)  = 


k = 0 

(The  unit-pulse  sequence). 

otherwi se 


By  assumption  = HS'i“1E,  then  (4.9)  becomes 


(4.10)  W(k,  1)  = E H(k) (S^”^E) (k)A(k-l -j ) for  each  (k,  1)  e CP. 

j-1 


By  the  same  argument  and  by  using  lemma  (4.3),  it  is  easy  to  show  that 
at  each  (k,  1)  e CP,  W^(k,  1)  (the  unit-pulse  response  of  E)  can  be 
expressed  as 


(4.11)  W (k,  1)  = E H(k) (SJ_1E) (k)A(k-l -j ) . 

j = l 

By  comparing  (4.10)  and  (4.11)  we  conclude  that  W(k,  1)  = W-(k,  1),  for 
each  (k,  1)  e CP;  that  is  E realizes  f^. 
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Finally,  by  noticing  that  W(»,  •)  can  also  be  written  as 


W(k,  1)  = E W. ,(l+l)A(k-l-i)  at  each  (k,  1)  e CP 
i =1 

and  by  the  assumption  W.  ^ = (S^~*H^)  E,  i e Z+,  we  can  show  (iv) 
implies  (i). 

□ 

Here,  it  is  important  to  emphasize  that  the  above  result  reduces 
into  (4.2)  when  the  system  E = (D,  E,  H)  is  constant. 

It  is  a well-known  fact  that  the  i/o  map  : 8™  8^  has  a time- 

invariant  realization  if,  and  only  if 

(i)  the  W_'s  are  time-independent  for  each  i ,j  e Z+, 

(ii)  the  W..'s  or  W..'s  satisfy  a recurrence  relation  over 

ij  Ji 

the  field  K;  that  is,  there  exist  scalars  bg,  b^,  ...,  b 
in  K such  that 

q-i  + 

(4.12)  W . = z b,W,  , . for  all  j e Z 

H1  *J  -j  _Q  1 1 T 1 9 J 


We  shall  show  next  that  in  the  discrete  time  varying  case,  there 
are  conditions  for  realizability  which  resemble  (4.12).  In  fact,  it  is 
interesting  to  observe  that  those  results  together  with  proposition 
(4.8)  are  the  discrete-time  versions  of  the  ones  obtained  by  KAMEN 
[1979]  in  the  continuous-time  analytic  case. 
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In  the  sequel,  we  shall  need  the  following  basic  fact. 

(4.13)  LEMMA:  f , , : Bm  -*•  B?  with  unit-pulse  response  W(«,  •)•  Then, 

W T + 

for  each  fixed  i , j e Z+ 

crW . . . = W . . . 

i+l, j i,j  + l 

where  a = right-shift  operator,  and  j is  defined  by  (4.1) . 

PROOF : Just  use  the  corresponding  definitions  to  justify  each  step  in 

(aWi+l,j)(k)  = Wi-l,j(k'1}  = W(k-l+i-l,k-l-j)  = 

W(k+1-1,  k-(j+l))  = W.  J+1(k)  , keZ 

□ 

(4.14)  THEOREM:  An  i/o  map  f : B™  -*■  B+  with  unit-pulse  response 

W(»,  •)  is  realizable  by  an  observable  system  £ = (D,  E,  H)  over  B 

(that  is,  rank  [h"'",  Sh\  ...  S^H^k)  = dim  £ at  each  k e Z,  for 

some  N e Z+)  if,  and  only  if  there  exist  pxp  matri ces  PQ,Pq,  •••»  pq  i 

over  B such  that 

(4.15)  Uqtl_  . =^P.W.+ur  forjn  j EZ+. 

PROOF:  (Necessity).  Suppose  that  the  i/o  map  f . , : 3m  -*■  8^  has  an 

W + T 

observable  realization  £ = (0,  E,  H)  over  B.  Then  by  theorem  (2.3.33) 
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rank  oj(k)  = rank[HT,  SHT,  ...  SN“1HT](k)  = n, 

where  N is  some  positive  integer. 

That  is  equivalent  to  say  that  the  nxn  matrix 
over  B.  Let  D be  the  px  Np  matrix  over  B defined  by 

o = csnht]t  (oJty-V  . 

Such  an  0 can  be  partitioned  in  (N-l)  blocks  so  that 

0 = [PQ,  pn-1] 

where  the  ;s  are  pxp  matrices  over  B. 

[S  H ] - 00N  = [PgjP-j^,  ...,  P|^_^ 


That  is, 

(4.16)  [SV]T  = V P.  (SV)1 

i =0 

But,  by  hypothesis  E = (D,  E,  H)  is  a realization 
from  proposi tion  (4.8) 


Therefore,  bj 


* T T 

(SH1)' 


(SN-lHT)T 


for  all  k e Z, 


0^0^  is  invertible 


construction 


of  fw;  therefore. 
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(4.17)  Wi;j  = (S1  V)  (S^-1E)  , for  i ,j  e Z+ 

In  particular 


WN+l,j  = (SVMS^E)  , j e Z+  . 

Next,  we  use  ((4.16)  to  get 

N-l  tT  . . 

(4,18)  WN+1  i = E MSV)  (SJ_1E)  , j e Z+ 

" A*J  i =0  1 

and  by  substituting  (4.17)  into  the  right-hand  side  of  (4.18)  we  have 

N-l 

UN+l,j  = P1Wi+l,j  for  a"  1 £ z+  • 

Hence,  the  unit-pulse  response  matrix  of  fw  is  recurrent  over  8. 
(Sufficiency)  Let  us  suppose  that  for  f^  the  recurrent  relation  in 
(4.1b)  holds  for  some  pxp  matrices  PQ,  Px,  ...,  Pq_1  over  8.  Consider 
the  following  pq-dimensional  system  E = (0,  E,  H)  over  B 


0n  ln  0n  0 0 

P P P P P 

o 0 I ...  o 0 

II 

Li_ 

w 

11 

W„, 

X 

ii 

* — 

I 

P 

o 

p p p p p 

21 

P 

• • • • • 

• • • • • 

• • • • • 

o 0 0 ...  o I 

p p p p p 

oP0  cPj  0P2  ...  aPq_2  „Pq_1 

- 

• 

• 

• 

w i i 

q-1,1 
U . 

q.i 

- -J 

0 

p 

0 

p 

L 
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where 


I 

P 


(A(i-j)) 


pxp 


Let  us  show  that  Z = (D,  E,  H)  realizes  over  B.  To  do  so,  let 
us  proceed  as  follows. 

We  know  that 


S^E  = D(a(S^  *E))  , for  all  j e Z+  , 

S°  = I 


Clearly  then 


S°E  = (W 


IT  21  ’ 


WT  ,)T 

q.i' 


A1  so 


SE  = D(aE)  = 


a W 


21 


31 


crW 


crW  , 
q-1 

Z (aP  )aW 
i =0  1,1 


39 


But  note  that 


q-1  q-1 

,f0  <oPl)0*,Hl,l  = 0(^o  Pi“l+l,l>  ' "Vl.l  (t>y  hyp0thes1s)  ' 


Hence 

SE  = [aW21;  aW31;  crW^+1  ^ x ] 

and  by  using  lemma  (4.13)  we  get 

SE  = [wj2;  W22;  W^2]T 

By  following  the  same  line  of  reasoning  as  in  above,  and  by  induction  on 
j,  it  is  easy  to  show  that 

(SJ_1E)  = [w}.;  W2j; 

Therefore, 

hsj_1e  = [Ip;  0p;  0p] 

and  by  proposition  (4.8),  we  conclude  that  Z realizes  fy. 

Finally,  we  prove  that  Z = (D,  E,  H)  is  observable  in  q-steps  at 
all  times.  So,  let  us  construct  oj  = [HT,  SHT,  ...,  Spq_1HT],  where 


. ; WnT  J for  all  j e Z+ 
H 5 J 


Ij 


2j 


W 

q»j 


= for  all  j £ Z , 
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T -IT  *i-1  T 
S1  H = a X(D 1 (S1  iH1)) 

a 

S°  = identity  operator 


Obviously, 


S1  HT  = < 


[0p,  Op,  ...,  Ip,  ...,  Op]  , for  i < q 
t 


ith  block  entry 


, for  i > q 


Therefore 


0 

q 


(A(i-j)) 


pqxpq 


I 

pqxpq 


which  clearly  has  rank  pq  at  each  k e Z;  that  is,  E is  observable. 


□ 


By  duality  we  obtain  the  following  result  on  the  existence  of 
reachable  realizations  E = (D,  E,  H)  over  3 of  fw. 

(4.19)  THEOREM:  A response  map  f,,  : 3m  ■*  BP  is  realizable  by  a 

reachable  system  z = (0,  E,  H)  over  B (i.e.,  rank  [E,  SE,  ..., 

SN_1E](k)  = dimE  at  each  k e Z for  some  N e Z+)  if  and  only  if  there 
exist  mxm  matrices  Qq,  ...,  Q ^ over  B such  that 
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(4.20) 


W. 


i , s+1 


s - 1 
E 


j=0 


w. 


i ,j+l 


PROO^:  Given  the  i/o  map  fy  : bJJ  -*•  bJ  : u -*•  fw(u)  : k * z W(k,  1) 

1 = -CO 

u(l),  consider  its  dual  fQ  :B^  * B™  with  unit-pulse  response 
W(k,  1)  = WT(1,  k)  for  all  (1,  k)  e CP  (see  (2.3.24)). 

A A 

Define  W^.(k)  :=  W(k-i,  k+j-1)  for  each  i , j e Z+,  each  k e Z+,  and 
note  the  following  relationship 


(4.21) 


U,  . = W . 
1J  J1 


Suppose  fw  is  recurrent  over  B in  the  sense  of  (4.20);  that  is, 


-1eZ+ 


By  taking  transpose  at  both  sides  of  the  above  equality,  we  have 


s-1  T . 

w i , = z q!  w.^ 
s+1»i  j=0  j j+i.i 


i e Z 


By  theorem  (4.18),  f*  has  an  ms-dimensional  realization  over  B, 
Z = (0,  E,  H)  which  is  observable.  Therefore,  by  proposition  (2.3.26) 

AAA 

the  dual  system  z = (0,  E,  H)  (see  definition  (2.3.8))  is  an 

ms-dimensional  realization  over  3 of  f^.  Furthermore,  it  follows  by 
duality  that  E is  reachable.  Hence  sufficiency  has  just  been  shown. 
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Conversely,  assume  that  fy  has  an  n-dimensional  reachable 
realization  E = (D,  E,  H)  over  B.  By  duality,  f*  is  realizable  over  B 

A AAA 

by  the  n-dimensional  observable  system  e = (D,  E,  H) . And  from  theorem 
(4.18),  there  exist  mxm  matrices  PQ,  P^,  ...,  P^  ^ over  B such  that 


(4.22) 


q-1 
= E P.W. 
i =0 


q+l.j 


, j e 1 


Take  transpose  at  both  sides  of  (4.22),  and  use  (4.21)  to  get 
(4’23)  “j.q+l  = Wj,i+1  Pi  for  each  J £ Z+  • 


Finally  by  making  the  following  substitutions  in  (4.23):  i -*•  j , j -*■  i , q 
•>  s,  p|  -*■  Q.  we  have 


• f°ra"  1 ^ 


That  is,  f ^ is  recurrent  over  B. 


□ 


(4.24)  REMARK.  Several  observations  about  theorems  (4.18)  and  (4.19) 

are  worthwhile  to  make,  among  them: 

(i)  They  are  the  discrete-time  counterpart  of  similar  results 
obtained  by  KAMEN  [1979]  for  analytic  time-varying  systems. 
This  is  due  to  the  fact  that  discrete  time  systems  can  be 
studied  in  terms  of  a semi  linear  transformation  which  is  the 
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discrete-time  counterpart  to  the  differential  transformation 
used  in  continuous-time  systems. 

(ii)  When  fw  has  a time-invariant  realization  both  criteria  for 
realizability  reduce  into  (4.12),  so  they  can  be  considered 
as  a generalization  of  such  a result. 

(iii)  The  realization  E = (D,  E,  H)  of  f^  used  in  the  proof  of 
theorem  (4.18)  is  not  minimal  in  general  as  it  can  been  seen 
in  the  counterexample  below. 


It  can  be  shown  that  the  Hankel  matrix  associated  with  fw  is  given  by 


(4.25)  COUNTEREXAMPLE.  Consider  f : 6 >8  with  unit-pulse 

W + + r 


response  matrix  W(»,  •)  given  by 


W(k,  1)  = (sin  | k)  cos  | (1  + 1)  , (k,  I)  e CP 


0 


0 


0 


2 % , 
-cos  j k 


0 


0 -sin2  j k 
Bw(k)  = -cos2  j k 0 


0 


0 


k e Z 


0 


+si n2  y k 


0 


2 71  . 
cos  y k 


0 


0 


. 2 n 
sin  j < 


0 


0 
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Hence  rank  B^( k ) = 1 for  each  k e Z (note  that  for  this  i/o  map  Bw  has 
constant  rank!).  Then  by  theorem  (3.2.15),  one  is  the  dimension  of  a 

minimal  realization  of  fw;  in  fact,  e=  (i,  cos  | k,  sin  | k)  is  a 
minimal  state  model  for  fw. 

On  the  other  hand,  it  is  not  hard  to  see  that 

i(k)  = (-l)W,  .(k)  + (0)W„  .(k)  for  each  j e Z+,  each  k e Z 
Hence,  s = 2,  pg  = -1,  p^  = 0;  and  S = (D,  e,  h)  given  by 


0 

1 

i — 

o 

1 

D(k)  = 

-1 

o 

\ 

; e(k)  = 

2 it  , 

cos  k 

is  an  observable  realization  of  f(/J  (see  proof  of  theorem  (3.2.15)). 
However,  it  is  not  minimal;  even  though  s = 2 is  the  smallest  positive 
integer  for  which  fw  is  recurrent  in  the  sense  of  (4.15).  Furthermore, 
it  is  not  even  a minimal  observable  realization  of  fw  (that  is,  an 
observable  realization  of  fw  with  smallest  dimension)  because  it  can  be 
shown  that  the  minimal  realization  T.  given  above  is  also  observable. 


CHAPTER  FIVE 

GLOBAL  REALIZABILITY  CRITERIA  BASED  ON  THE  HANKEL  MATRIX 


Most  of  the  existing  realization  algorithms  for  both  time-invariant 
systems  and  time-varying  continuous-time  systems  (see  Chapter  Two)  are 
based  on  the  notion  of  the  Hankel  matrix  associated  with  a given 
input/output  map.  For  example,  in  the  theory  of  realization  for  time- 
invariant  response  maps  over  a ring,  it  has  been  shown  that 
realizability  is  equivalent  to  finiteness  of  the  modules  generated  by 
the  elementary  rows  (or  columns)  of  the  Hankel  matrix  (see  ROUCHALEAU 
[1972]  for  details).  Furthermore,  such  a condition  is  also  true  for 
realizability  of  real  analytic  tiine-varyi ng  integral  operators  as  it  was 
shown  in  KAMEN  [1979].  Therefore,  it  seems  natural  then  to  develop  a 
similar  approach  for  discrete-time  varying  system. 

Given  a linear  i/o  map  f^  : B^  with  unit  pulse  response 

matrix  W(»,  •)>  we  have  defined  as  its  (generalized)  Hankel  matrix 
Bw(*)  the  following  infinite  matrix  (see  definition  (3.2.12)) 


11 

W12 

“13 

21 

W22 

W23 

31 

W32 

W33 
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where 


(5.2)  W.  . : Z ■*  Kpxm:  k -»•  W(k+i-l,  k-j)  for  each  i ,j  e Z+ 

J 

We  have  not  expressed  the  time-dependence  of  B^(*)  in  (5.1)  to  emphasize 
the  fact  that  its  entries  are  over  B. 

Let  Ri  denote  the  ith-block  row  of  Bw;  that  is,  Ri  :=  [W^,  Wi2, 
...]  where  the  j 1 s are  given  by  (5.2).  Denote  by  BPXP  the  (non- 

commutative)  ring  of  all  (pxp)-matrices  over  B,  and  define  X,^  as  the 
set  of  all  finite-linear  combinations  S P.R.  with  P.  e 8pxp,  where 

ii  i ’ 

1 u 

P-j R-j  :=  [Pi W-j  x , P-jWi2»  ...]•  It  is  rather  easy  to  show  that  X^ 
becomes  a left-module  over  the  ring  BPXP  with  componentwise  addition  and 


wi th  seal ar  mul 

ti plication  defined  by  PR^ 

:=  [PW 

ii*  PWi2’ 

• . . 3 * 

Also,  let 

be  the  ith-block 

col umn 

of  3W , 

i .e. , 

Ci  • = 

1 — 1 

• 

• 

#» 

1—  C\J 

1 — ^ 
1 — 1 

for  each  i e Z+.  Define  X., 

W 

as  the  set 

of  al 

1 finite 

linear  combinations  of  the  form  E C.Q. 

. i i 

with 

Qi  e Bmxm, 

and 

CiQi  : = 

T T 1 

[(W^Q^)  » (^2i  ^i ) ’ •••]•  With  addition  and  scalar  multiplication 

r 

defined  componentwise,  it  is  easy  to  see  that  X^  becomes  a right- 
module  over  Bmxm. 

Given  a left-(right)  module  M over  a ring  F,  we  shall  denote  the 
F-submodule  generated  by  elements  m^,  m2,  ...,  mq  in  M by  p<m1,  m?,  ..., 
mq>  (<ml5  m2,  ...,  mq>p). 

(5.3)  PROPOSITION:  There  exist  pxp  matri ces  Pq,  Pj^,  ...,  Pq_^  over  B 

sati sfyi ng 
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q-1  + 

W , , . = E P.w.^  . , j eZ 

q+Uj  i=Q  i i + l, J J 


if  and  only  if  is  finitely  generated  as  a left-module  over  BPXP 

with  generating  set  (R^,  R^,  R }. 


PROOF : Assume  that  X*  is  generated  by  the  blocks  rows  R^,  R2, 

R 1 of  that  is 


<R,,  Rq,  . . . , R > = X* 
Bpxp  1 V * q W 


Hence,  for  some  matrices  Pg,  P^,  P in  BPXP,  we  have  that 


q-i 

R ,,  = E P.R.^, 
q+i  i=Q  l 1+1 


That  is, 


rw  , , , w , • • • , w - 

q+1,1  q+1,2’  q+1 ,J 


q-i 


4-1 


4-1 


[ E P.W.  , , ; E P.W. E P.W.  . . ] 

i=0  i i+l,l  i=0  i 1+1,2’  i=(J  1 i+l, j;  ... 


By  comparing  component  by  component  we  get 


Vl.o  = +0  • for  3,1  J £ l' 
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Conversely,  let  us  assume  that  there  exist  pxp  matrices  Pg,  , 
• ...  P ^ over  B such  that 


W 


£ + i -i  for  each  j in  Z+ 

i =0 


By  theorem  (4.14)  the  system  S = (D,  E,  H)  given  by 


D = 


■ 

0 

I 

0 

0 

0 

W,  n 

p 

P 

P 

P 

p 

11 

0 

0 

I 

0 

0 

, E = 

W„, 

p 

p 

P 

P 

p 

21 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

0 

0 

0 

...  0 

i 

p 

p 

P 

P 

p 

aPn 

crP, 

aP0 

• • • &P  o 

crP  , 

w , 

0 

1 

2 

q-2 

q-i 

q.i 

«. 

j 

k J 

, H=[I  ,0  ,...,0  ] 

p p pJ 


is  a pq-dimensional  observable  realization  of  f , . . We  also  proved  that 


[S1  V]1  = [0p ; 0p ; . ..;  0p ; Ip;  0p ; ...;  0p]  for  i =1,  2,  ...  q . 

+ 

. tn 

i -position 

Therefore,  for  any  fixed  non-negative  integer  p,  there  exist  pxp 

matrices  cp„  , 4>  , ...»  cp  over  B such  that 

Up  ip  q-i,p 


[Sq+|iHT]T  = V 4,  (S1  HT) T . 

i =0 


By  proposition  (4.8)  we  know  that 
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Hence 


Wq+|j.+  l,j  = (Sq+tAHT)T(Sj_1£)  , for  each  j e Z+  . 


Wu  (*V)(sJ'1e)  > j EZ+ 


Using  again  proposition  (4.8)  we  get 


q-1 

Vn+l.J  = J for  each  j E Z+-  each  11  £ Z+u  (0> 


Finally,  from  the  definition  of  R ^ (recall  that  Rn-  = [W^, 
...])  we  get 


q-1 

Rn,  .,=  2 <(;.  R.,,  , for  all  p = 0,  1,  2,  ... 

q+p+i  i=Q  i >P  i +1 

relation  which  says  that  Xw  is  finitely  generated  as  a left-module  over 
tne  ring  BPXP  with  (R^,  R2,  ...  Rq}  as  a generating  set 

□ 

(5.4)  COROLLARY:  A linear  i/o  map  f^  : 8™  8q  is  realizable  over  B by 

an  observable  system  E = (D,E,H)  if,  and  only  if  is  finitely 

generated  as  a left-module  over  BPXP. 


PROOF:  Just  combine  theorem  (4.14)  and  proposition  (5.3) 


□ 
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(5.5)  PROPOSITION:  There  exist  mxm  matrices  Qg,  Q-^,  . . . , over 

B such  that  the  unit-pulse  response  matrix  W _of_  sati  sfi  es 

“i.sH  ' for  each  ieZ+ 

c 

if  and  only  if  Xw  is  finitely-generated  as  a right-module  over  Bmxm 
with  generating  set  {C^,  C ...,  C^}. 

PP00F : Just  use  the  dual  arguments  in  the  proof  of  proposition  (5.3). 

□ 

(5.6)  COROLLARY:  An  i/o  map  f^  : 8™  -*•  with  unit-pulse  response 

matri x W(»,  •)  is  realizable  over  B by  a reachable  system  E = (D,  £, 

C 

H)  if,  and  only  if,  X^  in  finitely  generated  as  a right-module  over 
gmxm 

PROOF : Just  use  proposition  (5.5)  and  theorem  (4.19). 

□ 

Let  r-j(cj)  denote  the  i ^h-el  ementary  row  (column)  of  the 

generalized  Hankel  matrix  associated  with  an  i/o  map  f^.  Denote  by 
r c 

XW(XW)  the  A-module  generated  by  the  r^'s  (c-j's)  with  addition  and 
scalar  multiplication  defined  componentwise.  Note  that  we  have  not  used 
the  distinction  between  left  or  right  in  the  above  definition  for 
multiplication  on  B is  commutative.  Furthermore,  it  is  important  to 
note  the  fact  that,  in  general,  X,^  and  X^  are  not  torsion-free 

modules  over  B since  it  can  happen  that  there  is  a non-zero  element  in 
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P C 

e XW  (V  f°r  wh1ch  there  exists  a non-zero  element  a in  B with  the 
property  am  = 0,  i .e . , m i s a torsion  element. 

Observe  that  the  B-module  X^j(X^)  is  finitely  generated  over  B if, 
and  only  if  the  BPxP-left  module  (Bmxm-ri ght  module)  X^(x[j)  is 

finitely  generated.  Therefore,  the  following  result  is  easily  deduced 
from  corollaries  (5.4)  and  (5.6). 

(5.7)  THEOREM:  A response  map  f ^ : B™  -*•  B^  is  realizable  over  B by  a 

reachable  (observable)  system  Z = (0,  E,  H)  if  and  only  if  X^(X^)  is 
finitely  generated  as  a module  over  B. 

An  interesting  question  is  whether  or  not  condition  (4.15)  or 
condition  (4.20)  is  necessary  for  realizability.  It  was  shown  in  KAMEN 
[1979]  that  for  analytic  input/output  maps  fy,  such  is  not  the  case  in 
general.  However,  for  discrete-time  varying  response  maps  it  is  true  as 
we  now  show.  By  the  way,  this  fact  is  another  significant  difference 

between  the  theory  of  realization  for  continuous-time  systems  and  the 
corresponding  one  for  discrete-time  systems. 

(5.8)  THEOREM:  Given  a linear  i/o  map  f,^  : 3™  -*  B^  with  unit-pulse 

response  matrix  W.  Let  X^(X^)  be  the  B-module  generated  by  the 

elementary  rows  (columns)  of  the  Hankel  matrix  associated  with  f ^ . 
Then  the  following  are  equivalent 

(i)  f ^ is  realizable, 

p 

(ii)  Xw  is  a fi ni tely-generated  B-module, 
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c 

(iii)  is  a finitely-generated  B-module. 

PROOF:  Assume  that  f : 8™  > Q?+  is  realizable,  then  by  theorem 

(3.2.15),  there  exists  a non-negative  integer  n such  that 

rank  Bw(k)  < n for  all  k e Z 

Therefore,  for  any  fixed  positive  integer  t we  have  that 

rank  B^(t)  = nt  < n 

Such  a relation  says  that  the  K-vector  space  generated  by  the  elementary 

columns  of  B^(t),  X^(t),  has  dimension  nfc.  Therefore,  there  exist 

vectors  bj*^,  ...,  b^  in  X^(t)  which  form  a basis  for  such  vector 

space.  Also  we  known  that  nt  < n,  so  we  pick  vectors  b^ b^ 

t nt+1  n 

in  X^(t),  which  can  be  completely  arbitrary,  and  form  a set  {b^, 
b^,  ...,  b^}  :=  3(t).  Clearly,  B(t)  is  a generating  set  for  X^(t) 
though  it  is  not  a basis  set. 

Finally  define  the  following  vectors  in  X^  (the  B-module  spanned  by 
the  elementary  columns  of  Bw) 

b-j(t)  :=  bj1^  for  each  t e Z . 

Obviously  the  set  B :=  (blt  b2,  ...,  bn>  generates  xjj  as  an 

B-module.  That  is,  X^  is  finitely  generated. 
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By  duality,  we  can  also  show  that  (i)  implies  (iii).  The  fact  that 
(ii)  or  (iii)  implies  (i)  is  a consequence  of  theorem  (5.7). 


□ 


Note  that  the  above  is  the  discrete-time  version  of  theorem 
(2.2.18)  due  to  Kamen.  However,  there  is  a basic  difference  in  that  for 
realizable  linear  i/o  maps  f : 8™  •+•  8j?  the  B-modules  Xr,  or  Xc,  do 
not  need  to  be  free  in  general  (tnat  fact  is  studied  in  more  depth  in 
Chapter  Six).  Another  important  difference  between  analytic  continuous- 
time systems  and  discrete-time  systems  is  that  for  the  former  it  is 
possible  to  have  X^(X^)  finitely  generated  while  X^(X^)  is  not  (see 
example  1 in  KAMEN  [1979]).  But  for  discrete-time  realizable  i/o  maps, 
both  X^  and  X^  must  be  finite  modules  by  theorem  (5.8). 


CHAPTER  SIX 

FINITE  CONSTANT  RANK  INPUT/OUTPUT  MAPS 

In  the  process  of  finding  a state-variable  representation  E = (D, 
E,  H),  if  there  exists  one,  for  a linear  system  described  by  its 
response  map  f^  : B+  *8^  we  should  always  look  for  a E having  minimal 
dimension.  Now,  recall  that  the  input/output  data  generated  by  a 

realization  E is  determined  only  for  those  states  (of  E)  which  are  both 
reachable  and  observable;  hence,  it  is  necessary  to  impose  a further 
condition  on  E,  and  that  is  "E  must  be  canonical".  By  proposition 
(2.1.14),  we  have  that  any  minimal  realization  of  a given  time-invariant 
i/o  map  f^  must  be  canonical,  and  vice  versa;  therefore,  both 
requirements  are  equivalent.  For  continuous  time-varying  integral 
operators  f^  the  situation  is  more  complicated  because  minimality  does 
not  imply  canonical  in  general  (see  SILVERMAN  [1971]);  although;  the 
converse  is  always  true. 

In  this  section  we  study  the  relationship  between  minimal 
realizations  and  canonical  ones  of  a discrete  time-varying  i/o  maps;  and 
we  shall  determine  cases  in  which  a canonical  realization  always 
exists.  Furthermore,  some  comparisons  between  the  theory  of  realization 
for  continuous-time  systems  and  the  corresponding  one  for  discrete-time 
systems  will  be  made. 
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One  of  the  most  important  classes  of  continuous-time  systems  is  the 
class  of  systems  which  have  constant  rank  (SILVERMAN  and  MEADOWS 
[1969]).  Recall  that  a system  E = (F,  G,  H)  over  A(J)  is  said  to  be  of 
constant-rank  if  there  exist  positive  integers  a,  p,  np  and  ng  such  that 

rank  R. (t)  = n^  for  all  i > a and  al 1 t e J 
rank  0. (t)  = nQ  for  all  i > p and  all  t e J 


where 


:=  [G,  Dp(G),  ...,  Op  1(G)]  = ith-reachabi  1 i ty  matrix  of  E 

Oi  •-  [H^,  Dp(H^),  0p“^(H^)]  = ith-observabi 1 i ty  matrix  of  E 

(see  (2.2.25)  and  (2.2.26)). 

Given  an  integral  operator  f : Cm(J)  +DP(J),  the  following 
interesting  facts  are  worthwhile  to  recall: 

(6.0-a)  (SILVERMAN  [1971]).  If  f^  is  realizable  by  a constant-rank 
system,  then  there  exists  a minimal  realization  which  is  also  constant 
rank.  In  fact,  any  minimal  realization  is  canonical. 
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(6.0-b)  (KAMEN  [1979]).  An  f ^ i s realizable  by  a constant-rank  system 
iff  there  exist  positive  integers  n and  p sucn  that 

rank  B^(t)  = n for  all  i > p,  and  all  t e J 
(see  theorem  (2.2.29) ) . 

(6.0-c)  (KAMEN  [1979]).  The  modules  X.C,  and  x!'.  are  finite  and  free  with 

W W 

c r 

rank  Xw  = rank  Xw  = n if,  and  only  if,  fw  is  realizable  by  a constant- 
rank  system. 

It  is  natural  then  to  find  the  discrete-time  counterpart  for  the 
above  results.  Due  to  the  lack  of  continuity  of  the  rank  of  a given 
matrix  over  6,  the  following  definition  of  constant  rank  system  in  the 
discrete  framework  is  adopted: 

(6.1)  DEFINITION:  Given  a discrete  time-varying  system  I = (D,  E,  H) 

°ver  we  shall  say  that  L is  a constant  rank  system  if  there  exist 
positive  integers  a,  p,  np  and  nQ  such  that 


rank  R.(k)  = n^  for  all  i > a and  all  k e Z 


rank  0i  (k)  = nQ  for  all  i > p and  all  k e Z 
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where 


Rj  :=  [E,  SE,  S1  *E]  = ith-reachability  matrix  of  £ 


^ :=  [H  , SH  , S1  = i ^-observabi  1 i ty  matrix  of  £ 


(6.2)  EXAMPLE:  Let  £ = (D,  E,  H)  be  given  by 


1 

0 

0 

2Z 

<f 

( 

1 " 

- 

sin  j k 1 0 

D ( k ) = 

0 

1 

0 

m 

II 

1 

0 

; HT(k)  = 

0 1 1 

0 

0 

1 

1 

0 

L 0 

It  is  not  hard  to  show  that  for  each  i e z+ 


R.(k)  = 


A(k)  1 A(k-l)  1 A(k-2)  1 

10  10  10 

10  10  10 


A(k-i)  1 

1 0 

1 0 


k e Z. 


Cl  early 


rank  R.(k)  = 2 for  all,  i > 1 and  all  k £ Z 
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On  the  other  hand 


02(k) 


sin  k 1 0 

0 1 1 

si  mt(k+l)/2  1 0 

0 1 1 


k e Z . 


Therefore,  rank  02(k)  = 3 for  all  k e Z (E  is  observable). 
From  definition  (6.1),  E is  a constant  rank  system. 


Given  a linear  i/o  map  fy  : B™  ■>  with  unit-pulse  response 
matrix  W,  let  By  be  its  (generalized)  Hankel  matrix  (see  definition 
(3.2.12)).  For  each  i e Z+,  associate  with  fy  the  ith-submatrix  By^ 
of  By  defined  by 


(k) 


Wn(k) 

W21(k) 


W12(k) 

W22(k) 


wn(k)  w.2(k) 


• • • ^2(k) 

. . . ( k ) 


for  k e Z 


where 


wij(k)  = W(k+i-l,k-j)  i ,j  e Z+  , 


k e Z 
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(6.4)  PROPOSITION:  A linear  input/output  map  f : B™  -»•  is  realizable 

by  a finite-dimensional  system  Z = (D,E,H)  over  B if  and  only  if  for 
each  positive  integer  i 


wl1ere  0^  (Rj  ) i s the  ith-observabi  1 i ty  (reachability)  matrix  of  E (see 
(2.3.32)) 

PROOF:  By  proposition  (4.8),  fy  is  realizable  by  E if  and  only  if 


Wjj  = [S1  V]V  4]  for  each  i , j e Z+ 


Therefore, 

from  (6.3)  E is 

a realization  of 

ft/l  if  for  each  i e 

• 

(S°HT)T(S°E) 

T T 

(sVhse)  ... 

(S°HT)T(S1-1E) 

a(D  _ 
Bw  ■ 

(SHT)T(S°E) 

• 

(SHT)(SE) 

• 

(SHT)T(S1_1E) 

• 

• 

(S1_1HT)T(S°E) 

• 

• 

(S1_1HT)T(SE) 

(S1"1HT)T(S1'1E) 

*— 

w 

The  preceding  result  will  be  used  frequently  in  the  sequel. 

(6.5)  DEFINITION:  A linear  input/output  map  f^:  8™  -►  is  said  to 

have  finite  rank  ff  there  exist  positive  integers  p and  n such  that 

(6.6)  rank  B^(k)  < n for  all  i > p and  all  k e Z 

(6.7)  THEOREM:  A linear  i/o  map  f^:  B™  * B^  has  finite  rank  if  and  only 

if  it  is  realizable. 


PROOF:  Assume  that  fw  is  realizable  over  the  causal -half  plane  CP.  By 

theorem  (3.2.15)  there  exists  a finite  positive  integer  n such  that 

(6.8)  rank  B^(k)  < n for  each  k e Z 

Since  is  a submatrix  of  Bw  (see  (6.3)),  it  must  be  true  that 

rank  B^(k)  < rank  Bw(k)  for  each  i e Z+  and  each  k e Z 


Ill 


By  using  (6.8)  we  have 

rank  B^(k)  < n for  all  i e Z+,  and  all  k e Z 

Conversely,  suppose  that  (6.6)  holds.  By  taking  into  account  that 
BW^  * Bw  as  1 ”•  we  obtain  that  rank  Bw(k)  < n for  all  k e Z.  Thus 

fw  is  realizable  (by  theorem  (3.2.15)) 

□ 

Next,  we  introduce  a class  of  i/o  maps  f^  which  have  several  nice 
properties  as  we  shall  see  later. 

(6.9)  DEFINITION:  An  input/output  map  fw:  8™  ■>  B^  is  said  to  have 

finite  constant  rank  if  there  exist  positive  integers  p,  n such  that 

(6.10)  rank  B^(k)  = n for  all  i > p and  all  k e Z 
At  once  we  have  the  following  result. 

(6.11)  PROPOSITION:  Let  f^:  8™  B^  be  a finite  constant  rank  response 

map.  Then  the  following  statements  are  true 

(i)  is  realizable,  and  n (see  (6.10))  is  the  dimension  of  a 
minimal  realization 

( i i ) for  each  \ eZ , f w has  an  n -dimensional  minimal  realization  on 
CPX  (recall  CPx:={(k,Jl)  e ZxZ:  k > \ > 1}). 
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PROOF: 

(i)  from  definition  (6.5)  and  theorem  (6.7),  it  follows  that  any 
i/o  map  fw  with  finite  constant  rank  is  realizable.  The  last 
part  of  the  statement  is  obtained  by  using  theorem  (3.2.15) 

(ii)  It  follows  directly  from  (i)  and  from  theorem  (3.2.9).  (Here 
you  need  to  recall  that  CX(W)  = Bw(\).) 

□ 

(6.12)  REMARK:  In  general,  a realizable  i/o  map  f^  need  not  be  finite 

constant  rank.  For  a counterexample  see  (3.2.17). 

(6.13)  PROPOSITION:  Let  f^:  8™  ->  be  a linear  i/o  map  with  finite 
constant  rank.  Then  f^  is  realizable  by  a constant  rank  system  E = 
(D,E,H)  over  8 (see  definition  (6.1)). 

PROOF:  From  the  definition  of  a finite  constant  rank  response  map  fw, 

we  have  that  there  exist  p,  n e Z+  so  that 

(6.14)  rank  B^(k)  = n for  all  i > p,  k e Z. 

By  proposition  (6.11),  a minimal  realization  £ = (D,E,H)  of  f^  must  have 
dimension  n.  Now,  let  R^(O^)  denote  the  ^-reachability  (observa- 
bility) matrix  associated  with  z.  Then,  it  must  be  clear  from  (2.3.32) 
that  for  each  i e Z+ 

rank  Ri (k)  < n,  for  al 1 k e Z 


(6.15) 


113 


(6.16)  rank  O-j(k)  < n,  for  all  k e Z. 

Since  z realizes  fw,  from  proposition  (6.9)  it  is  known  that  for  each 
i e Z+ 

(6.17)  = Oi(k)Ri(k),  k e Z 
Apply  Sylvester's  law  to  (6.17)  to  obtain 

(6.18)  rank  B^1 ) < min  (rank  0i(k),  rank  R. ( k ) } , k e Z 

Take  i > p,  and  use  (6.14)  to  conclude  from  (6.18)  that 
(6-19)  n < rank  O-j(k),  for  all  k e Z 

(6.20)  n < rank  Ri  (k) , for  all  k e Z. 

Finally  combine  (6.15)  with  (6.20)  and  (6.16)  with  (6.19)  to  conclude 
that 

rank  R. (k)  = n for  al  1 i > p,  k e Z 


rank  0^ (k)  = n for  all  i > p,  k e Z. 
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Therefore  E is  a constant  rank  realization  of  fw  (note  that  E is 
canoni cal ) . 


Unfortunately,  the  converse  of  proposition  (6.13)  is  not  true  in 
general.  A counterexample  is  given  below. 

(6.21)  COUNTEREXAMPLE:  Consider  the  scalar  system  E = (D,e,h)  given  by 

0 = e(k)  = (});  h(k)  = (h^k),  h2(k)) 

where 


h^(k)  = h2(k)  = 1 for  all  k ^ 0 

h]_(0)  = -h2(0)  = 1 


It  is  not  hard  to  see  that 

rank  R^k)  = 1 for  all  i > 1,  and  all  k £ Z 

rank  0i(k)  = 1 for  all  i > 1,  and  for  all  k e Z 

That  is,  E is  a constant-rank  system  which,  of  course,  realizes  its  own 
i/o  map  f^..  However , it  can  be  shown  that  the  generalized  Hankel  matrix 
3W  associated  with  f^  is  given  by 
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Vk)  = 


hx(k)  + h2(k) 
0 


As  a result,  we  have  that 


0 

0 


0 ... 


0 ... 


, k e Z 


rank  B^(k) 


rank  B^^(k) 


= < 


1 for  k * 0 


0 for  k = 0 


for  all  i > 1. 

Hance  f£:  8+  -*  B+  is  not  a finite  constant  rank  i/o  map;  although  it  has 
a constant  rank  realization. 

The  above  example  shows  a basic  difference  between  the  theory  of 
realization  for  discrete  i/o  maps  and  the  correspondi ng  one  for  analytic 
continuous-time  integral  operators.  The  difference  is  that  in  the 
latter  (see  (6.0-b))  the  converse  of  the  above  proposition  is  always 
true. 


(6.22)  COROLLARY:  Any  minimal  realization  z = (D,E,H)  of  a finite 

constant  rank  i/o  map  fw:  B™  ->  8^  is  canonical  . 
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fROUFj  It  follows  from  the  proof  of  proposition  (6.13). 

The  above  result  shows  us  an  interesting  characteri sti c of  any 
finite  constant  rank  response  map  fw  which  is  that  “minimal"  implies 
canonical".  However,  this  is  not  true  for  arbi trary  realizable  i/o 
maps  as  we  now  show  with  the  following 

(6.23)  COUNTEREXAMPLE  (WEISS  [1972])  Consider  the  i/o  map  f,^:  B+  * B+ 
whose  unit-pulse  response  is  given  by 

W(k,£)  = (A(k-5)  + (A(k-6))(AU-3)  + a(A-4))  for  all  (k,X)  e CP, 


where 


Mj)  = { 


1,  if  j = 0 ; 


0,  otherwise 


Weiss  gives  the  following  minimal  realization  of  f, 


d = 1;  e(k)  = A(k-4)  + A(k-5);  h(k)  = A(k-5)  + A(k-6) 


For  such  systems 
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rank  (k)  = < 


1»  k = 4,  5,  6 . . . (5  + i - 1) 


0,  otherwise. 


rank  0^(k)  = < 


1 , k - (5  - i + 1) , . . .5,6, 


0,  otherwise. 


That  is,  E is  neither  reachable  nor  observable. 

We  have  seen  then  that  E is  a minimal  realization  but  is  not 
canonical.  This  fact  was  not  observed  by  Weiss. 


(6.24)  PROPOSITION:  Let  E = (D,E,H)  be  an  n-dimensi onal  canonical 
realization  of  a given  linear  i/o  map_  fw:  8™  * bJ.  Then  fw  has  finite 
constant  rank  and  E is  a minimal  realization. 

PROOF:  E canonical  implies  that  there  exist  positive  integers  a,  p such 
that 


(6-25)  rank  R.(k)  = n for  all  i > a,  and  all  k e Z, 

(6-26)  rank  0. (k)  = n for  all  i > p,  and  all  k e Z. 


Since  E realizes  fw  by  proposition  (6.4)  we  have  that  for  each  i e Z+ 


118 


(^•27)  B,^1  ^ (k)  = CK  (k)R..  (k)  at  every  k e Z. 

Apply  Sylvester's  law  to  the  relation  (6.27)  to  get 

(6.28)  rank  B^(k)  < min  (rank  0.(k),  rank  R.(k)},  i e Z+,  k e Z 

By  taking  i > p:=max  (a,p)  and  by  using  (6.25)  and  (6.26)  we  get  from 
(6.28)  that 

(6-29)  rank  B^(k)  < n for  each  i > p,  k e Z. 

On  the  other  hand,  (6.24)  implies  that  for  each  i > a,  and  for  each  k e 
Z the  matrix  R-j(k)  has  a right  inverse  ^(k).  Therefore,  by 
premultiplying  both  sides  of  (6.26)  by  R.  (k)  we  have 

(6.30)  B^l)(k)Ki(k)  = 0.(k)  i > p,  k e Z 

Apply  Sylvester's  law  to  (6.30)  to  obtain 

rank  B^(k)  > n for  al 1 i > p,  k e Z 

which  together  with  (6.29)  says  that 

rank  B^(k)  = n for  all  i > p,  k e Z. 
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Hence,  f^  has  finite  constant  rank  and  by  proposition  (6.11)  E is  a 
minimal  realization. 

□ 

Now,  by  combining  corollary  (6.22)  with  the  above  proposition  we 
can  show  the  following  result* 

(6.31)  THEOREM:  Let  fw:  * BP  be  a linear  input/output  map  with 

finite  constant  rank.  A realization  Z = (D,E,H)  of  fw  is  minimal  if  and 
only  if  it  is  canonical . 

The  interesting  feature  of  this  result  is  that  it  is  the  discrete- 
time counterpart  of  a result  due  to  SILVERMAN  [1971]  (see  also  theorem 
(2.2.28))  for  continuous  time-varying  systems.  Such  a characteri sti c of 
finite  constant  rank  i/o  maps  f^  is  of  basic  importance  in  this  project 
because  it  will  allow  us  to  find  concrete  realizations  of  f,^  (see 
Chapters  Seven  and  Eight). 

To  really  appreciate  the  importance  of  linear  i/o  maps  f,  - 8m  ->  Bp 

W + + 

with  finite-constant  rank,  let  us  show  the  following  striking  result. 

(6.32)  THEOREM:  Let  f^  : B™  * Bp  be  a response  map  with  unit-pulse 

response  matrix  W(  • , •).  Then  f^  has  a canonical  realization  if  and 
only  if  it  has  finite  constant  rank. 

PR00F : Has  a canonical  realization,  then  it  has  finite-constant 

rank  by  proposition  (6.24).  On  the  other  hand,  if  fw  has  finite-rank, 
then  it  has  a canonical  realization  by  corollary  (6.22). 
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Therefore,  the  preceding  result  tells  us  that  for  the  only  kind  of 
discrete  time-varying  i/o  maps  that  there  exists  a canonical  realization 
is  those  with  finite  constant  rank. 

(6.33)  PROPOSITION:  Let  f ^ : B™  -»  B^  be  an  i/o  map  with  finite 

constant  rank  n,  then  the  B-modul  es  X^  and  are  both  finite  and 

free  with  rank  n. 


£R00F_:  Since  any  i/o  map  f^  with  constant  rank  is  realizable,  by 

theorem  (5,3)  we  get  that  both  B-modul  es  X,^  and  X,^  are  finitely 
generated.  So  we  need  to  show  only  that  they  are  free  with  rank  n. 

By  definition  there  exists  a positive  integer  p such  that 

(6.34)  rankB^  ^ (k)  = n for  al  l i > p,  and  all  k e Z 

Next,  define  the  following  column-truncated  Hankel  matrix  for  each 
i in  Z+: 


1 — * 
1 — * 

“12 

• * • 

“n 

21 

“22 

• • • 

“21 

31 

“32 

• • • 

“31 

where  the  prefix  "ct"  stands  for  column  truncated. 


121 


Because  of  (6.34)  it  must  be  clear  that  for  each  i > p, 

(6.35)  rankB^Jk)  = rank(ctB^ (k))  = rankBy(k),  k e Z . 
c 

Since  Xy  is  finitely  generated  by  the  first  pm-el ament ary  columns  of 
By  which  are  the  elementary  columns  of  ctB^,  we  must  have  that 

(6.36)  X.j  = B-module  generated  by  the  columns  of  ctB,^ 

w w 

From  (6.35)  we  obtain  that 

rank(ctBy^  (k) ) = n for  each  k e Z 

So,  for  each  k in  Z,  there  exist  n columns  c^  /,  v , ...,  c^  , -x 

1 1 \ K v 'nU  j or 

ctB^(k)  which  are  a basis  for  Xy(k)  = K-vector  space  spanned  by  the 

elementary  columns  of  ctB,^(k). 

w 

Next,  denote  by  B~  the  B-module  consisting  of  all  infinite  column 
vectors  over  B (addition  and  scalar  multiplication  are  defined 
componentwise).  Define  the  following  elements  in  3°° 

bj(k)  :=  ci.(k)  for  each  J in  (x»  2>  •••>  nh  all  k e Z 
J 

From  the  very  definition  of  the  bj's,  it  is  easy  to  see  that  they  are 
K-l i near  independent  at  each  k e Z.  Therefore,  by  lemma  (A. 1.5),  blf 

b2’  bn  ara  ^-linearly  independent.  Furthermore,  it  must  be  clear 

that  they  are  also  elements  of  Xc . 

W 
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From  (6.36)  it  follows  that  any  x in  X^  can  be  written  as 


m^ 

x = £ a. c,  , a.'s  in  B, 
i = l 1 

but  note  that  for  each  i e {1,  2,  . . . , m}  and  for  each  k e Z 


c,(k)  = E a..(k)b,(k)  for  some  a..(k)'s  in  K 
j=l  J J1 


Hence,  it  must  be  clear  that 


n |im 


x(k)  = E ( E a. (k)  a..(k))b.(k)  for  each  k e 
j=l  i =1  1 J1  J 


That  is. 


n 

x = E x .b . 
j=l  J J 


(J4T1 


where  x.(k)  - E a. (k)a..(k)  , for  each  k e Z 


i = l 


i Ji 


• c 

Since  x in  Xu  was  completely  arbitrary  we  have  that 


XW  <bi'  b2 ’ “*5  bn>3 


We  have  thus  shown  that  b, , . ..,  b are  a basis  for  the  B-module  XC. 

1 M w 

Therefore,  X^  is  free  with  rank  n. 


123 


6y  the  same  line  of  reasoning  as  above  and  by  working  with  8^,  it 
is  possible  to  show  that  the  B-module  is  also  free  with  rank  equal 
to  n. 

□ 

The  next  natural  step  is  to  see  whether  or  not  the  converse  of  the 
above  proposition  is  also  true. 

(6.37)  PROPOSITION:  Let  f^  : B1^  * 8P  be  a linear  i/o  map,  and 

consider  the  B-modules  and  X,^  associated  with  its  generalized 
Hankel  matrix  ( ' ) . _If_  X.^  and  X^  are  both  finitely  generated  and 
free  with  rank  n,  then  there  exists  a positive  integer  p such  that 

rankB, ^(k)  = n for  all  i > p,  and  all  k e Z ; 

that  is,  fy  has  finite  constant  rank. 

PROOFj  By  hypothesis  both  xJJ  and  X^  are  finitely  generated.  It  must 

be  clear  then  that  both  Xw  and  X(>J  are  also  finitely  generated.  And 

from  propositions  (5.3)  and  (5.5),  there  exist  positive  integers  q and  s 
such  that 

(a)  (Rp  ...,  R^}  is  a generating  set  of  xj^  as  right  module  over  8pxp 

(b)  {0^  ...,  Cs>  is  a generating  set  of  X^  as  a left  module  over  Bmxm 
where  R-j  (C^ ) is  the  i th -bl ock  row  (column)  of  Bw. 
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With  p,  :=  max(q , s)  we  have  that  Xw  is  generated  by  R,,  ...,  R 
C 

while  Xw  is  generated  by  C-^,  C2,  . ..,  C^.  Therefore 

rankB^(k)  = rankB^(k)  for  all  i > p.  , and  all  k e Z . 

To  complete  the  proof,  then,  we  need  only  to  show  that 
rank  B^(k)  = n for  all  k e Z. 

By  hypothesis  X^  is  the  free  with  rank  n.  Then  by  definition,  X^j  admits 
a basis  set  {b , b,,,  . . . , b^},  where  each  b^  e X^. 

Due  to  the  fact  that  the  b^ 1 s are  B-linearly  independent,  it 
follows  from  proposition  (A. 1.3)  that  b1(k) , ...,  bn(k)  are  K-linearly 
independent  for  each  k in  Z.  That  is, 

(6.38)  rank  [b^k),  b2(k),  . . . , bn(k)]  = n for  all  k in  Z. 

By  definition  of  basis,  we  have  that  each  elementary  column  c^  of 
8^  can  be  expressed  uniquely  as  a 8-linear  combination  of  b^,  b^,  ..., 
bn.  In  particular,  that  means 

n 

ci  = I aii  i = 1,  2,  . . . , n 

j = l J1  J 


for  some  a . • 1 s in  B. 
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Therefore,  for  each  k e Z we  can  write  the  following  matrix 
rel ati on 


(6.39)  Cc1(k) , c2(k),  . . . , c^(k)]  = [b^k),  . . . , bn(k)]A(k) 

where  A(k)  :=  (a.  . (k) ) 

ij  v ' 'pm  x pm 

Next,  let  denote  the  matrix  consisting  of  the  first  up-rows  of 
Cbl»  bn]«  Then,  it  is  not  hard  to  see  from  (6.39)  that 

(6.40)  B^(k)  = J (k)A(k)  for  each  k e Z. 

By  applying  Sylvester's  inequality  to  (6.40)  and  by  noticing  that  is 
a submatrix  of  [b]_,  ...,  bn]  it  is  easy  to  show  that 

(6.41)  rank  B^(k)  = n for  each  k e Z 

On  the  other  hand,  since  X,^  is  generated  by  c^,  c2,  ...,  cpm  we 
have  that  for  each  i e {1,  2,  ...,  n} 

pm 

bi  ’ tjici  • Vs  in  B • 

Hence,  at  each  k e Z we  can  write  the  following  matrix  relation 
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(6.42)  [b1(k),b2(k),  ...,  bn(k)]  = [c^k) ,c2(k) , ...,  c (k)]T(k), 

M”* 

where  T(k)  :=  (t,  . (k) ) 

ij'  x n 

Define  as  ^-(C-j)  the  ip  x n (ip  x pm)  matrix  formed  by  the  first  ip- 
elementary  rows  of  [blf  b2,  bn]  (of  [clf  c2,  c^]),  and  use 

(6.42)  to  obtain 


^(k)  = C.(k)T(k) 

From  Sylvester's  inequality  applied  to  the  above  equality,  we  obtain 
that  for  each  i e Z+ 

rank  J..(k)  < rank  C..(k)  for  each  k e Z. 

Also,  note  that  the  following  relations  are  true 

[b-i , • « • , b ] = J 
i n 0° 

[c . , . . . , c . 

1 pm  oo 

Hence,  from  the  above  inequality  we  get 


(6.43)  n = rank  [b^k),  ...,  bn(k)]  < rank  [c^k),  ...,  cn(k)],  k e Z. 
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But  from  the  relation 

rank  B^(k)  = rank  B^(k),  k e Z , 

it  follows  that  rank  B^}(k)  = rank  [c^k),  ...  , cn(k)],  for  each  k e 
Z.  And  from  (6.43)  we  have 

n < rank  B^(k)  for  all  k e Z 

Therefore,  we  have  shown  that 

rank  B^(k)  = n for  all  i > (i,  and  all  k £ Z 

i.e.,  fy  has  finite  constant  rank  by  definition. 


By  combining  propositions  (6.33)  and  (6.37)  we  obtain  the  following 
criteria  to  determine  when  an  i/o  map  f^  has  finite  constant  rank. 

(6.44)  THEOREM:  A linear  i/o  map  f ^ : R™  ->■  R^  with  unit-pulse  response 

matnx  w( • » * ) has  constant  rank  n if,  and  only  if,  the  B -modules  and_ 

r 

xw  are  finitely  generated  and  free  with  rank  n . 

Combining  the  above  results  we  have  the  following  equivalent 
conditions  for  realizability 
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(6.45)  THEOREM:  Given  a linear  input/output  map  fw:  8™  > 8^  with 

associated  Hankel  matrix  V the  following  statements  are  equivalent 

(i)  f|j  has  finite  constant  rank  equal  to  n;  i.e.,  rank 

= n,  Tor  all  i > n,  al  1 k e Z,  for  some  positive 
i nteger  (a; 

( i i ) f w has  a canonical  realization  of  dimension  n ; 

( i i i ) the  B-modul es  and  are  finitely  generated  and  free  with 

rank  X^  = rank  X^  = n. 


CHAPTER  SEVEN 
CANONICAL  REALIZATIONS 


In  this  section  we  shall  find  an  abstract  realization  of  an  i/o  map 
f w with  finite  constant  rank  which  is  the  di screte-version  of  one  given 
in  KAMEN  [1979]  for  analytic  integral  operators. 

Denote  by  B the  set  of  all  infinite  column  vectors  over  B.  By 
defining  vector  addition  and  scalar  multiplication  componentwise,  it  is 
easily  shown  that  B°°  becomes  a B-module.  Given  a fixed  positive  integer 
p,  define  the  following  transformation  on  B” 


X1 

■ - 

xl+p 

x2 

— + a 

X2+p 

x3 

• 

• 

x~ 

3+p 

• 

* ^ 

i 

where  a is  the  right-shift  operator  on  B. 

It  is  very  easy  to  show  that  6 is  additive,  and  that  for  any  a e 

P 

B,  x e B°° 


^p(ax)  = (aa)<|>  (x) 
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Therefore,  we  observe  that  <|>p  becomes  a semi  linear  transformation  on  B°° 
with  respect  to  a.  Note  ^ is  the  discrete-time  counterpart  to  the 
pseudo-linear  transformation  Xp  defined  in  the  theory  of  time-varying 
analytic  systems  (see  KAMEN  [1979]). 

Let  fw:  8™  ->  B^  oe  linear  i/o  map  which  has  finite  constant  rank 
equal  to  n;  that  is, 

(7.2)  rank  B^(k)  = n for  all  i > p,  and  all  k e Z, 

for  some  finite  nonnegative  integer  n. 

Consider  the  B-mod.ules  and  X^  associated  with  Bw  (recall 

i p c 

that  XW(XW)  is  the  3-module  generated  by  the  elementary  rows  (columns) 

of  8^).  It  must  be  clear  that  X^  is  a B-submodule  of  8°°.  Hence,  it 

makes  sense  to  study  further  properties  of  based  upon  its  effects  on 

elements  of  Xc,. 

w 

Given  a matrix  M = (m^,  m2,  ...,  mn)  with  m^  e 800,  we  shall  denote 

by  4.  (M)  the  matrix  ((Mm.),  4,(111.),  ...,  4,  (m  )). 
r p i p 1 p n 


(7.3)  PROPOSITION:  Let  c-j  denote  the  i -el ementary  column  of  the 

generalized  Hankel  matrix  associated  with  a linear  i/o  map  f,^:  B™  •>  B^. 
Then 


Vci}  = ci+m  ^-e-dCh  1 £ Z+ 


(7.4) 


131 


PROOF:  Denote  by  Cj  denote  the  jth-block  column  of  the  Hankel  matrix 

Bw;  that  i 
(7.1)  that 


B^;  that  is  0^  = [W^.,  W^,  . . . ].  Then,  it  follows  immediately  from 


(7.5) 


<1>  (C.)  = 
P J 


aW0 . 
2j 


a W 


3j 


By  lemma  (4.13),  we  know  that 


aW . 


i +1 , j = W1  ,j+l  for  a”  ' ’J  E z+ 


Therefore  4>  (C.)  in  (7.5)  becomes 

r J 


4-  (C.)  = 

p r 


w,  . . 
i,j+i 

W2,j  + 1 


for  each  j e Z 


From  such  a relation,  it  is  not  hard  to  see  that  <b  (c.)  = c 

pv  l ' m+i 


□ 


(7.6)  COROLLARY:  x^.  is  a ^-invariant  B-subtnodule  of  B".  That  is. 


yx£i>£x;i 
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PROOF : Let  x e be  completely  arbitrary.  By  definition  of  X^,  x can 

be  expressed  as 

co 

x = V a.c. 
i=l  1 1 

where  the  family  (ai  : i e Z+)  is  a finite  subset  of  B,  i.e.,  almost  all 
a^'s  are  zero.  Therefore 


Vx)  = aici>  = ji1 


That  is, 


^p(x)  « Xj 


(from  (7.4)) 


□ 


c 

Since  Xw  is  ^-invariant,  cLp  can  be  restricted  to  xj  to  obtain  a 
semi  linear  transformation 

(7.7)  : x[j  ^ Xw:  x ^ ^p(x) 

By  using  ^ we  shall  be  able  to  construct  a minimal  realization  for 

a given  i/o  map  fw  satisfying  (7.2).  In  fact,  when  fw  has  finite 

constant  rank  n,  by  theorem  (6.44)  xjj  is  a finitely  generated  free 

module  over  B with  rank  n.  This  means  that  XC,  admits  a 

w 

basis  { b ^ , b^,  ...,  b^}  with  each  b^  e X^.  Therefore,  any  element  x 

can  be  expressed  uniquely  as 
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n 

(7.8)  x = l x. b.  , x.  e B. 

i =1  11  1 


As  a consequence  of  corollary  (7.6),  for  each  i e {1,  2,  n}  we  have 
that  4>p(b.j)  e X^.  Hence,  because  of  (7.8) 


*P<bi> 


n 

- I 

j = l 


d- , b . for  some  d . . 1 s e B. 
J J ' J 


Let  D denote  the  n x n matrix  over  B defined  by 


(7.9)  D :=  (d^.)nxn  . 

Note  that  D is  simply  the  matrix  representation  of  <j)  with  respect  to 

? 

the  basis  (bl5  b2,  ...,  bn>  of  xjj. 

Next,  let  Bm  denote  the  B-module  consisting  of  all  m-element  column 
vectors  over  8.  It  should  be  clear  that  Bm  is  finitely  generated  and 
free  with  rank  m.  In  fact,  the  unit  vectors  e^,  e2,  ...,  in  Bm  form 
a basis  for  such  a module. 

Let  E and  H denote  the  following  B-module  homomorphi sms 


E :B 


W‘ 


m 

* ik  ^ 1 


(7.10) 
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(7.11) 


And  denote  by  E (respectively  H)  the  matrix  representation  of  E(H)  with 
respect  to  the  basis  {b^,  b2»  • ..,  bn>  in  and  the  standard  basis  ep 
e2’  em  in  Bm  ((ei»  e2»  • ••»  ep)  in  Bp}. 

Our  next  step  is  to  show  that  the  n-dimensional  system  z = (D,E,H) 
is  in  fact  a realization  of  f^.  From  proposition  (4.8)  we  know  that  Z 
is  a realization  of  fw  if,  and  only  if, 


(7*12)  W = HSJ'“*E  for  all  j e Z+ 


Now,  due  to  the  fact  that  D,  E,  H are  respectively  the  matrix 
representations  of  <j)  , E,  and  H,  condition  (7.12)  is  equivalent  to 

*(£)))(e. ) = ith-column  of  W.  . 

r I 1 J 

for  each  i e {1,  2,  ...,  m}  and  j e Z+. 

From  (7.10),  it  is  seen  that 


(7.13) 


E(a. ) = l A ( i - j ) c , 
j=l  J 


c,  for  each  i e (1,  2,  . . . , m} 


where 
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A(i)  = 


1,  i =0 

0,  otherwise  . 


But,  by  proposition  (7.3)  we  know  that  <jl  (Cj ) = ci+m.  And,  it  can  be 
shown  by  induction  on  j the  following  relation 


(7.14)  1(ci)  = ci+(j_1)m»  for  each  j e Z+,  each  i e {1,2,  ...,  m} 


Now,  combine  (7.13)  and  (7.14)  to  obtain 


(clj"1E)(e  ) = c 
P M i+(j-l)m  ‘ 


Finally,  from  the  definition  of  IT  (see  (7.11))  we  have 


1E)(ei)  = first  p-elements  of  c..,.  lX  , 
P 1 i+  j-1  in  ’ 


(j-l)r 


which  is  in  fact  the  ith-column  of  Wij.. 

We  have  thus  shown  that  E = (D,E,H)  is  an  n-dimensional  realization 
of  fw.  Furthermore,  from  theorem  (6.45)  is  follows  that  E is  a minimal 
canonical  realization  of  such  an  i/o  map. 

It  should  be  noted  that  when  using  the  above  procedure  to  construct 
a realization  for  fw,  it  does  not  matter  if  you  use  x!',  or  X?,.  And  the 
reason  is  that  when  fM  has  finite  constant  rank,  xj  and  xj  have  the  same 
rank  (see  theorem  (6.44)).  Therefore,  in  either  case  you  get  a 
(minimal)  canonical  realization.  This  is  a particular  feature  of 
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di screte-ti ms  systems  which  does  not  exist  for  analytic  time-varying 
ones  since  in  the  latter  xJJ(X^)  may  be  free  while  X^(X^)  is  not  (see 
KAMEN  [1979]  for  details). 


CHAPTER  EIGHT 

COMPUTATION  OF  CANONICAL  REALIZATIONS 


In  this  section,  we  give  an  algorithm  to  construct  canonical 

realizations  of  input/output  maps  f ^ : B+  -*•  B+  with  finite  constant  rank 

equal  to  n.  This  result  is  the  discrete  version  of  Kamen's  algorithm 

for  constructing  minimal  realizations  of  real  analytic  time-varying 

integral  operators.  Therefore,  it  is  not  surprising  that  the  major 

problem  here  is  the  computation  of  a basis  for  the  module  X,c,  which  by 

w 

theorem  (6.45)  is  finite  and  free. 

Given  a linear  response  map  fy:  -*■  B^  with  finite  constant  rank 

equal  to  n;  that  is,  there  exists  a positive  integer  p such  that 

rank  B^(k)  = n for  all  i > p,  and  al 1 k e Z 

By  theorem  (6.45),  both  modules  xj  and  X^  are  finitely  generated  and 
free  with  rank  n.  Therefore,  there  exist  positive  integers  q and  s such 
that 


X 


c 

W 


c 

qm 


> 


B 


137 


138 


XW  " <rl’  r2’  ’ ‘ ‘ ’ rps>B 

h 

*vhere  c-j^)  is  the  i -elementary  column  (row)  of  8W  (the  generalized 
Hankel  matrix  associated  with  fw). 

Let  \i  :=  max(q,s),  and  let  r be  any  s x q submatrix  of  B.^  such 

W 

that 


(i)  s > p , 


(ii) 


with  rank  r(k)  = n for  all  k e Z. 

By  using  the  discrete-time  version  of  Dolezal's  theorem  (see 
theorem  (A. 1.14)  in  the  appendix),  there  exist  matrices  A e B1^  and  Q e 
3Sxn  such  that 


(i) 

(ii) 

( i i i ) 


rA  ' o„(q.n)]> 

A is  invertible  over  B, 
rank  Q(k)  = n for  all  k 


e Z. 


It  follows  from  corollary  (A. 1.16)  that  there  exists  a basis  (bj,  t>?, 
•••,  bn)  for  satisfying 


(8.1) 


[b 


r v 
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Next,  consider  the  mappings  $ , E,  H defined  by  (7.7),  (7.10)  and  (7.11) 
respectively.  From  the  definition  of  E,  it  must  be  clear  that 

(8.2)  [E(e1),E(e2),  ...,  E(en)]  = = [b x ,b2 , ...,  bn]E  (see  (7.13)) 

where  Cj_  denote  the  first  block-column  of  the  Hankel  matrix  By. 

Let  Q denote  the  submatrix  of  the  first  block  column  of 

w 

corresponding  to  the  rows  of  r.  Then  from  (8.1),  it  is  clear  that 

(8.3)  Q = QE 

Premultiply  both  sides  of  (8.3)  by  the  left-inverse  of  Q to  obtain 

(8.4)  E = (QTQ) -1QTQ  . 

Also,  from  the  definition  of  H (see  (7.11)) 

[H(b1)  ,H(b2) , ...,  H(bn)]  = first  p-rows  of  [b  ^ ,b  ^ , ...,  b ] = H • 

8y  using  (8.1),  we  observe  that 


(8.5) 


H = first  p rows  of  Q 
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On  the  other  hand,  from  the  definition  of  <j)  (see  also  (7.9)) 


[4p  (t>i ) ,4p  (b2 ) , •••,  4p(bn)]  = 


because  of  (8.1),  we  can  restrict  <j)  to  the  columns  of  Q to  get 


(8.6)  $ (Q)  = QD  . 


Next  recall  that 


(i)  4n(ax)  = (aa)<|>  (x)  for  each  a e 8,  and  each  x e X.c, 

r P W 


("  > rA  * [Q;  °sx(q-n)]  ' 


Then,  from  (8.6)  it  is  not  hard  to  see  that 


(8-n  HptQ);  0sx(q-n)]  “ *p(f4)  - »p(r)(»A)  , 


where 


a = right-shift  operator, 


4p(r)  - submatrix  of  whose  first  column  is  located 

m-elementary  columns  to  the  right  of  the  first  column  of  r. 


and  whose  rows  correspond  to  those  of  r. 
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Finally,  combine  (8.6)  and  (8.7)  to  obtain 
(8.8)  D = first  n-columns  of  (QTQ)  "V*  (r)  (aA)  . 

Now,  from  results  of  Chapter  7 the  system  E = (D,E,H)  given  by 
equations  (8.8),  (8.4)  and  (8.5)  is  a minimal  canonical  realization  of 

fw 

It  is  worthwhile  to  make  the  following  comments  about  the  above 
realization  algorithm: 

(i)  The  most  difficult  step  (from  the  standpoint  of  computation) 
is  the  determination  of  the  matrices  A and  Q,  or  equivalently  the 
construction  of  a basis  for  the  8-module  xjj.  In  general,  it  is  not 
possible  to  find  those  matrices  in  a finite  number  of  steps  because  of 
the  structure  of  the  ring  8 (at  each  k e Z,  A(k)  and  Q(k)  can  be  found 
by  reducing  r(k)  to  its  column  echelon  form).  However,  it  follows  from 
known  results  of  linear  algebra,  that  when  the  entries  of  the  unit  pulse 
response  W(-,.)  belong  to  a subring  A of  B,  A Deing  a Bezout  domain,  A 
and  Q can  be  determined  via  a finite  sequence  of  multiplication  of  r 
using  q x q invertible  matrices  over  A.  For  example,  when  K = R (the 
field  of  real  numbers)  and  the  subring  A may  be  taken  as  R[k],  the  ring 
of  polynomials  with  real  coefficients,  or  as  the  subring  consisting  of 
all  finite  sums  of  sequences  of  the  form  e 1 cos  ^k  sin  c.jk  with  a-, 
bi , ci  e R. 

(ii)  Weiss's  algorithm  in  theorem  (2.3.44)  can  be  viewed  as  a 
particular  case  of  the  realization  procedure  presented  here. 


For  the 
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former,  it  is  needed  that  8,^  contain  an  n x n submatrix  with  rank  n 
at  each  k e Z,  while  for  the  latter  the  submatrix  r need  not  be  n x n. 
Below,  we  give  an  example  to  illustrate  not  only  our  realization 
procedure,  but  also  to  show  that  the  assumption  that  there  is  an  n x n 
invertible  submatrix  of  may  not  be  true;  even  though  fw  has  finite 
constant  rank. 

(iii)  If  f^  has  a time-invariant  realization,  then  the  algorithm 
will  give  a constant  minimal  realization. 


(8.10)  EXAMPLE:  Consider  the  scalar  input/output  map  f^:  8+  + B+  with 

unit-pulse  response  W(k,l)  = si n | k cos  | (1 +1)  for  al 1 (k,l)eCP. 
The  Hankel  matrix  8W  associated  with  fw  is  given  by 


Vk>  a 


0 

2 u . 
cos  k 

0 

2 it  , 

-cos  2 k 
0 

2 n , 
cos  ^ k 


sin^  j k 
0 

. 2 it 

-sin  k 
0 

. 2 it  , 

sin  j k 
0 


0 

2 it  , 

cos  2 k 
0 

2 it  . 

-cos  2 k 


-sin^  j k 
0 

. 2 it  , 

sin  2 k 
0 

. 2 it 

-sin  2 k 
0 


, keZ . 


It  is  easily  seen  that 


rank  8^(k)  = 1 for  all  i >2,  and  al 


k e Z . 


That  is,  f,^  has  finite-constant  rank  equal  to  one. 
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Note  that  Weiss  algorithm  can  not  be  used  here  to  find  a canonical 

realization  of  fw  because  there  is  not  a lxl  submatrix  of  with  rank 

one  at  each  k e Z.  However,  we  can  still  use  our  procedure.  In  fact 

(2) 

take  r(k)  = (k).  By  performing  a sequence  of  elementary  column 

operations  on  r we  can  find  that 


and 


A(k)  = 


2 n 

cos  k 


. 2 n . 
sin  j k 


sin2  j k 


2 n . 

cos  j k 


Q(k)  = 


sin2  | k 


2 it  . 

cos  2 ^ 


The  left-inverse  of  Q is  equal  to 


(QT(k)Q(k))_1QT(k)  = [sin2  | k cos2  | k]  . 


Also,  we  have  that 


0 

cos2  | k 


Q(k)  = 


144 


0 


4p(r) (k) 


0 


2 it  , 

-cos  k 


2 % 

cos  ~2  k 


( crA ) ( k ) 


Finally,  from  formulas  (8.4),  (8.8)  and  (8.5)  we  find  the  minimal 

canonical  realization  £ = (d,e,h) 


We  shall  conclude  this  section  with  an  application  of  the  algorithm 
developed  here  to  system  reduction.  A discrete  time-varying  system 
£ = (D,E,H)  over  8 is  said  to  be  reducible  if  £ is  not  a minimal 
realization  of  its  response  map  fE  defined  by  (2.3.7).  However,  in 
order  to  reduce  a given  £ by  using  our  realization  procedure  it  is 
required  that  fE  has  finite  constant  rank. 

Given  an  n-dimensional  system  £ = (D,E,H)  over  8,  let  Bw  denote  the 
(generalized)  Hankel  matrix  associated  with  the  system's  input/output 


d(k)  = sin2  k - cos2  | k 


e(k)  = cos^  ^ k 


h(k)  = si n2  k 
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map  fj,  (see  (2.3.14)),  and  let  , 0^  denote  the  i^-reachabi  1 ity  and 

X.  L_ 

i tn-observabi 1 ity  matrix  of  E;  that  is 
Ri  = [E,  SE , . . . , S1_1E] 

0i  = [HT,  SHT,  . . . , Si_1HT]T  . 

(8.11)  PROPOSITION:  Let  E = (D,E,H)  be  a finite-dimensional  system 

oyer_  B for  which  there  exists  positive  integers  a,  p such  that 

rank  Ri(k)  = rank  Ra(k)  for  all  i > a,  and  all  k e Z, 

rank  0i(k)  = rank  0p(k)  for  all  i > pf  and  all  k e Z. 

rank  B^(k)  = rank  B^(k)  for  all  i > p,  and  all  k e Z, 

P : = max  {a,p},  B,^(k)  is  the  submatrix  of  Bw  given  by 


wu(k)  W12(k)  ...  W1.  (k) 


w21(k) 

• 

w 2 2 ( k ) 

• • • 

• 

“d<k> 

w12(k) 

...  W . . ( k ) 

(8.12) 

(8.13) 
Tnen 

(8.14) 
where 
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and 


Wij(k)  " W( k+i -1 , k-j)  for  all  k e Z,  and  all  i ,j  e Z+ 


PROOF: 


Since  £ is  a realization  of  its  i/o  map  fs,  it  follows  from 
proposition  (6.9)  that 


(8.15) 


^ = 0.  Ri  for  each  i e Z+ 


Let  p.  max(a,p),  then  the  relation  (8.12)  says,  in  particular,  that 


rank  R^+1(k)  = rank  R (k)  for  all  k e Z 


Hence,  there  exists  a pmxm  matrix  A over  8 such  that 

(8.16)  S^E  = R A . 

P 

Likewise,  it  can  be  shown  that  relation  (8.13)  implies  that  there  is  a 
pxpp  matrix  r over  8 such  that 


(8.16) 


(s^ht)t  = ro 


From  (8.14)  we  observe  that 

W 


= 0 R 

W p+ 1 p+ 1 


can  be  written  as 
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R S^E 


(By  definiton  of  R.  and  0^ ) 


0 R 

H V- 


0 (S^E) 


(StiHT)rR  (S^HT)r(S^E) 

r* 


i(n) 


0 (S^E) 
li 


(S^HT)TR  ( S^H1 ) T(Sm’E) 

r* 


(3y  (8.14)) 


By  using  (8.15-16)  and  (8.14)  we  have  then  that 


(8.17) 


B,^a 

rt  W 


rB^  tb^a 

w w 


Now,  due  to  the  fact  that  is  a submatrix  of  B^+1^  (see  (8.17)), 


it  is  clear  that 


>(n+U 


rank  B^Tiy(k)  > rank  B^(k)  at  each  k e Z 


On  the  other  hand,  observe  that  the  right-hand  side  of  (8.17)  an  be 


written  as 


[I  A],  where  I = identity  matrix.  Therefore, 
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(8.18)  8,^+1)  = 


[I  A]  . 


By  using  Sylvester's  inequality  we  obtain  from  (8.18)  tnat 


rank  B^+1)(k)  < rank  B^(k)  at  each  k e Z 


We  have  thus  proved  that 


>(p+l) 


rank  B^'i;(k)  = rank  B^(k)  at  each  k e Z 


As  a result,  the  relation  (8.14)  follows  immediately  by  using  inducti 


on 


on  l . 


□ 


As  examples  of  systems  satisfying  the  hypothesis  of  proposition 
(8.11)  we  have  those  systems  over  B that  have  constant  rank. 


(8.19)  THEOREM:  Let  E = (0,E,H)  be  an  n-dimensional  system  over  B 

satisfying  the  hypothesis  of  proposition  (8.11).  Then,  the  i/o  map  fE 
associated  with  E has  a canonical  realization  if  and  only  if  there 
exists  a positive  integer  n < n such  that 

(8.20)  rank  B^(k)  = n for  all  k e Z 

Furthermore,  if  (8.20)  holds  a canonical  realization  of  f^  can  be 
computed  from  B^+^  . 
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fROOF_:  Suppose  fs  has  a canonical  realization  of  dimension  n,  by 

proposition  (6.24)  fs  must  have  finite-constant  ranK.  Therefore,  it 
follows  from  definition  (6.9)  and  proposition  (6.11)  that 


rank  B^(k)  = n for  all  k e Z 


Conversely,  assume  that  relation  (8.20)  holds.  Since  fs  satisfies 
(8.14),  fj.  has  finite  costant  rank  equal  to  n (by  definition). 
Therefore,  by  theorem  (6.32),  f£  is  realizable  by  a canonical  system. 

Finally,  the  last  statement  of  the  theorem  is  proved  by  noticing 
that  when  f^  has  finite-constant  rank  (that  is,  (8.20)  holds),  a minimal 
(canonical)  realization  can  be  computed  by  using  the  realization 
procedure  developed  in  this  section,  and  in  order  to  do  that,  we  need 
only  to  know  . 

□ 

(8.21)  EXAMPLE:  Consider  the  system  T.  = (D,e,h)  over  8 given  by 


D(k) 


0 0 0 

0 m+uiik-ii+i)  0 

o o 1 


— — 

1 

l 

0 

; h (k)  = 

1 k | + 1 

si  n j k 

1 

<-  — 

* ^ 

e(k)  = 
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It  is  not  hard  to  show  that  E is  a constant  rank  system  with  a = 2, 
p = 1.  Furthermore,  rank  B^(k)  = 1 for  all  k e Z (here  p = 2),  where 


00 


1 + sin  k 
1 + sin  j K 


1 - cos  j k 
1 - cos  k 


Then,  by  theorem  (8.19),  f^  has  a canonical  realization  whose  dimension 
is  one  (see  theorem  (6.45)),  and  in  order  to  compute  one  we  need  only  to 
know 


(8.22)  8<3)(k)  = 


1 + sin  j k 1- 

1 + sin  | k 1 - 

1 + sin  k 1 - 


cos  j k 

1 

- sin  -| 

71 

cos  k 

1 

- sin  j 

cos  k 

1 

- sin  § 

It  is  interesting  to  observe  from  (8.22)  tnat  Weiss's  algorithm  can  not 
be  used  in  this  case  because  there  is  not  a fixed  lxl  invertible 
submatrix  of  . However,  our  realization  procedure  can  be  used.  In 

fact,  take  r(k)  = 3,^2)(k)  since  rank  B,^2)(k)  = 1 for  all  k e Z. 

Applying  the  basis  construction,  we  obtain  that 


1 1 - cos  k 

2 + sin  j k - cos  j k 

1 -(1  + sin  k) 

; Q(k)  = 

2 + sin  ^ k - cos  j k 

J 

- J 

A(k)  = 
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Hence, 


Q(k)  = 


1 + sin  4 k 


1 + sin  Tj-  k 


[^(OKk)  = 


1 - 


1 - 


% , 

cos  2 k 


it  i 

cos  2 k 


1 - 


1 - 


it  . 

sin  2 k 


71 

sin  y K 


(oA)(k)  = 


1 - sin  2 k 


1 . /V  , 

■1  + cos  2 k 


Finally,  by  evaluating  formulas  (8.4),  (8.8)  and  (8.5)  the  following 
canonical  (minimal)  realization  of  fE  is  obtained. 


d(k)  = 


2 - (cos  | k + sin  j k) 
2 + sin  k - cos  k 


e(k)  = 


1 + sin  4 k 


2 + sin  j k - cos  -5  k 


h(k)  = 2 + sin  I k - cos  | k 


CHAPTER  NINE 

CONCLUSIONS  ANO  OPEN  PROBLEMS 


By  introducing  the  concept  of  generalized  representative  series 
into  the  theory  of  discrete  time-varying  systems  we  have  been  able  to 
find  necessary  and  sufficient  conditions  for  real  i zabi 1 i ty  given  in 
terms  of  the  Hankel  matrix.  Such  criteria  can  be  considered  "local" 
because  they  require  the  computation  of  the  rank  of  an  infinite  matrix 
at  each  instant  of  time  k. 

In  addition  to  the  local  real i zabi 1 i ty  criteria,  the  algebraic 
framework  developed  in  this  work  yields  global  criteria  for  a linear 
discrete  time-varying  i/o  map  to  be  realizable. 

This  global  approach  to  realizability  provides  additional  insight 
into  the  structural  characteristics  of  the  problem  in  the  discrete  time- 
varying  case.  In  fact,  the  results  of  Chapters  Two  and  Three  show  how 
realizability  criteria  in  the  time-invariant  case,  and  in  the  real 
analytic  time-varying  case,  generalize  to  criteria  in  the  discrete  time- 
varying  framework. 

We  have  also  answered  the  important  question  as  to  which  kinds  of 
i/o  maps  always  have  a canonical  realization,  and  we  have  shown  that  for 
only  those  maps  a realization  is  canonical  if  and  only  if  it  is 
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minimal.  Furthermore,  it  has  been  seen  that  the  construction  of  such 
state-space  models  reduces  to  the  problem  of  computing  a basis  for  a 
finitely-generated  free  module  over  the  ring  B. 

As  it  was  noticed,  there  is  a lot  of  similarity  between  the 
algebraic  approach  developed  here  and  the  module  approach  to 

realizability  in  the  theory  of  real  analytic  time-varying  systems. 
Actually,  the  reason  for  such  a similarity  rests  on  the  fact  that  both 
theories  are  given  in  terms  of  pseudo-linear  transformations  which  are 
not  linear  with  respect  to  the  module  structure  of  B and  A(J) 

respectively.  It  was  this  observation  made  by  KAMEN  [1979]  that 
motivated  most  of  the  work  done  in  this  dissertation. 

There  are  several  aspects  of  the  approach  taken  here  which  deserve 
investigation: 

(P.l)  Let  E = (Q,E,H)  be  an  n-dimensional  system  over  B,  and  let 
fs  be  its  i/o  map.  Suppose  that  E is  a constant  rank  system  with 

"parameters"  <z,  p,  np,  nQ  (see  definition  (6.1))  with  D * 0.  Does  fE 
have  finite-constant  rank?  We  have  shown  that  when  D = 0,  the  answer  to 
that  question  is  generally  "no".  However,  most  of  the  examples  with 

13  * 0 tell  us  that  with  p = max  (a,  p) 

rank  B^(k)  = min  (np,no)  for  al  1 i > p,  and  al  1 k e Z 

(P.2)  Given  a realizable  i/o  map  f^  which  does  not  have  constant 
rank,  develop  an  algorithm  to  construct  a minimal  realization  E. 
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(P.3)  Can  the  canonical  realization  procedure  given  here  be 
specialized  so  that  it  yields  a stable  realization  with  bounded 
coefficients  whenever  the  given  i/o  map  is  bounded-input/bounded-output 
(BIBO)  stable. 

(P.4)  How  can  we  construct  "partial"  realizations  of  any  i/o 
map?  The  greatest  difficulty  with  this  topic  consists  in  giving  an 
appropriate  definition  of  the  problem  in  such  a way  that  it  has  a 
feasible  "physical"  interpretation,  and  that  it  generalizes  the  existing 
one  for  time-invariant  systems.  Another  important  step  to  the  solution 
of  this  problem  will  be  to  choose  the  "right"  algebraic  methodology. 
Unfortunately,  the  algebraic  framework  developed  in  this  work  does  not 
look  promising  to  obtain  the  desired  answers;  however,  it  is  believed 
that  a good  technique  would  be  the  theory  of  non-commutati ve  formal 
power  series  (see  FLIESS  [1974], [1976], [1978]) . 


APPENDIX  ONE 


DISCRETE  VERSION  OF  OOLEZAL'S  THEOREM 

Let  B denote  the  ring  of  all  K-valued  bi-infinite  sequences.  Also, 
let  M be  any  B-module.  Given  a finite  set  of  elements  in  M,  say 
£ = {m^,  rr^,  . . . , mn}  we  have  the  following 

(A. 1.1)  DEFINITION:  A finite  set  £ is  said  to  be  B-linearly  dependent 
if  there  exists  scalars  r^,  r^,  ...  , rR  in  B (not  all  zero)  such  that 

(A. 1.2)  r.m,  + r„m0  + . . . + r m =0 
112  2 n n 

Otherwise,  the  set  5 is  said  to  be  B-linearly  independent. 

For  a fixed  postive  integer  p,  Bp  will  denote  the  B-inodule 

consisting  of  all  p-element  column  vectors  whose  entries  are  elements  of 
8.  Furthermore,  by  300  we  will  represent  the  R-module  of  all  infinite 
column  vectors  over  B. 

EXAMPLES:  (a)  let  M = B.  It  is  interesti  ng  to  observe  that  the 

only  R-li nearly  independent  sets  of  3 are  those  formed  by  single  non- 
zero elements  of  R.  For  suppose,  you  have  a set  with  more  than  two 
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elements,  say  {m^  m2>  . . . , m } =:  \ and  0 jt  £.  Then  by 

r 1 = m2 » r2  = "ml>  r3  = r4  = • • • = rn  = 0,  we  have  that  (A. 
sati sfied. 


(b)  Here  let  M 


xx(k)  = 
Let  e R such 


o 

= B . And  consider  the  following  vectors  in 


71  , 

si  n 2 k 

, x2 ( k ) 

■ 

it  , 

cos  2 k 

it  i 

-cos  2 k 

it  , 

sin  j k 

— 

- w 

that 


r ix  l + r2x2  = 0 


i .e. , 


sin  | k 

cos  k 

r1(k) 

0 

-cos  k 

sin  j k 

J 

r2(k) 

V- 

0 

But  det 


71  , 

sin  2 k 


it  , 

-cos  j k 


71  , 

cos  k 


sin  | k 


o Q 

= sin  | k + cos^  k = 1 for  all  k 


J 


By  using  well  known  results  in  linear  algebra  we  conclude 


rx(k) 

r2(k) 


taki ng 
1.2)  is 

B2: 

Z 


= 0 for  all  k e Z 
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That  is  rj_  = r2  = 0. 

Therefore,  and  x2  are  linearly  independent  over  8. 

(c)  In  order  to  generalize  example  (b)  to  higher  dimensions  we 
propose  the  following  not-hard-to-prove  result:  "Gi yen  p vectors  x^, 

x2’  xp  lH  They  are  B-l  inear  independent  if  and  only  if  the 


— X ^xl’  x2;  ...;  Xp]  e BPXP  is  invertible.  That  is,  they  are 
R-li nearly  independent  if  det  X(k)  * 0 for  all  k e Z." 


(A. 1.3)  PROPOSITION:  Let  {m^ , m^,  ...,  m11}  be  an  B-linearly 

independent  set  of  vectors  in  BP(B°°).  Then  for  each  k e Z,  the  set  of 
1 2 

actors  (m  (k) , m (k) , . . . , mn(k ) } kP(K°°)  js_  K-linearly  independent. 


PROOF:  Assume  there  exists  a kj  in  Z such  that  m1(k1),  m2(k1),  ..., 

mn(k^)  are  K-linearly  dependent.  By  definition,  there  exists  scalars 
<*1»  ag,  ...,  an  in  K,  not  all  zero,  such  that 

1 2 

a^m  (k^)  + a2m  (k^)  + ...  + armn(k^)  = 0 . 


Define  the  following  functions  r^:Z  ■>  K by 


ri  (k) 


k = k. 


= < 


i =1,  2, 


0,  otherwise 
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Obviously,  the  r ^ 1 s are  in  8,  and  not  all  of  them  are  zero. 
Furthermore, 


l c.  n 

r^in  + r2m  + ...  + rnm  = 0 

Contradiction! 

□ 

(A. 1.4)  PROPOSITION:  Given  a set  of  vectors  in  bP(B°°),  {m\  m2, 

•••>  mn(k)  such  that  for  each  k e Z,  the  vectors  m^k),  m2(k),  ..., 
mn(k)  are_  K-li nearly  independent.  Then  the  set  (m1 , m2,  ...,  m11}  is 
B-linearly  independent. 


PROOF: 

Let  a^,  a2,  ...,  an  be  any  set  of  scalars  in  B satisfying  the 
rel ation 


1 o 

ayn  + a2nr  + ...  + anmn  = 0 
which  is  equivalent  to 

(A. 1.5)  a^(k)m  (k)  + a2(k)m  (k)  + ...  + ar|(k)mn(k)  = 0,  for  each  k e Z. 

By  hypothesis,  for  each  k e Z the  set  m^k),  ...,  mn(k)  is  k-linearly 
independent.  Hence,  from  (A. 1.5)  we  have 
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a]_(k)  = = •*'  = = U f°r  each  k e ^ 

That  is,  a^  — a 2 — • • • = ap|  = 0 • 

□ 

By  combining  propositions  (A. 1.3)  and  (A. 1.4)  we  get  the  following. 

(A. 1.6)  LEMMA:  A set  of  vectors  (m1,  m2,  ....  mn}  j_n_  Bp(6°°)  _i_s. 

B-1  i nearly  independent  if,  and  only  if,  for  each  k e Z the  vectors 
m (k),  nr(k),  . ..,  mn(k)  are  K-li nearly  independent. 

Also  in  the  sequel  we  shall  need  the  next  result. 

(A.  1.7)  THEOREM:  Let  8 be  a nontrivial  commutative  ring  and  M be  a 

free,  finitely  generated  B-module.  Then  there  exists  a positive  integer 
n such  than  any  basis  B of  M has  cardinality  n.  Such  a number  n is 
called  the  rank  of  M. 


PROOF: 

See  KNIGHT  [1971]. 

□ 


Let  r be  any  pxq  matrix  over  B.  We  shall  denote  by  IrnT  the 
B-module  generated  by  the  q-columns  of  r.  In  other  words,  if 
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12  * x 

r = [y  , Y . •••»  Yq]  where  y1  = [y^  , y^. , ....  Yp.  ]T  E 8P,  i = 1, 

2j  •••  9 c|j  then 


(A. 1.8)  Im(r)  :=  <y1,  y2, 


:=  { l 

1 = 1 


V 


ai 


R} 


Now  we  are  ready  to  show  the  discrete-time  version  of  Dolezal's 
theorem  (which  is  probably  known). 


(A. 1.9)  THEOREM:  Let  r be  any  pxq  matrix  over  8.  The  6 -module  Imr  is 

free  with  rank  n if,  and  only  if 


rank  r(k)  = n < ® for  all  k e Z 

PROO^:  (Necessity)  Assume  tnat  Imr  is  free.  By  theorem  (A. 1.7),  it 

has  finite  rank  n.  That  is,  Imr  admits  a basis  b^,  ...  , bn,  where 

each  bi  e Imr.  Because  of  (A. 1.8)  for  each  i e (1,  2,  . . . , n} 

b.j  = ^ tjiTJ  for  some  t.'s  in  8 

Let  A :=  [b^  bg,  ...  bn]  e Bpxn  , 


T :=  [t.  .] 

L ijJqxn 


Then,  it  is  not  hard  to  see  that 
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(A. 1.10)  A = rT 


On  the  other  hand,  from  the  definition  of  a basis  we  have  that  the 
n column  vectors  of  A are  B-l inear  independent.  And  by  using  lemma 
(A. 1.6)  together  with  well  known  results  of  linear  algebra  we  conclude 

(A. 1.11)  rank  A(k)  = n for  all  k e Z 


From  relations  (A. 1.10)  and  (A. 1.11)  together  with  Sylvester's 

inequality  we  can  show 


(A. 1.12)  rank  r(k)  > n for  all  k e Z 


Since  {b^,  b£,  ...,  bn>  is  a basis  of  Imr,  each  y1  can  be  expressed 
uniquely  as 


n 

Y1  = l U b i = 1,  2,  ...,  q 
j=l  J J 


That  is. 


(A. 1.13)  r = AU 


u 


[U.  .] 
1J 


nxq 


where 
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By  using  Sylvester's  inequality  again  together  with  (A. 1.11)  we  obtain 
from  (A. 1.13) 

rank  r(k)  < n for  all  k e Z 
Therefore,  we  have  shown  that 

rank  r(k)  = n for  all  k e Z 

(Sufficiency)  Here,  suppose  that  rank  r(k)  = n < <»  for  all  k e Z.  By 
definition  of  rank  of  a matrix  over  a field,  we  have  that  for  each  k e Z 
there  exist  columns  Yi  ^ ( k ) » Y i 2 ( k ) ’ • • • * Yi n ( k ) » oY  r wh''ct1  are 

K-l  i nearly  independent  (y-j  . ( k ) means  that  the  position  of  the  column  may 
vary  with  time). 

Next,  let  us  define  elements  in  BP  by 
b = Yi  (kl  for  each  k e z>  J e {1,  2,  ...,  n} 

r ' 

Clearly,  for  each  k e Z the  vectors  b^(k),  t>2(k),  ...,  b (k)  are 
K-l i nearly  independent.  Hence,  from  lemma  (A. 1.6)  they  are  also 
8-1 i nearly  independent. 

Observe  that  for  each  k e Z by  using  permutation  of  columns  of  r 
and  by  deleting  some  of  them  we  can  write 


Cbx(k) ; b2(k);  ...;  bn(k)]  = r(k)A(k) 
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That  is 


[b^  b 2 ; bn]  = ta  with  a e 6qxn 
The  above  relation  says  that 


bi  e I(n(r)  , i = 1,  2,  ...»  n 
In  resume:  {b]_,  b2,  ...,  bn>  satisfies 

(i)  They  are  B-linearly  independent. 

(ii)  Each  b^  is  an  element  of  Imr. 

To  show  that  they  form  a basis  for  the  B-module  Imr  we  need  to  prove 
only  that 


ImT  - <bp  b2’  •••»  bn>B 

So  let  x e Imr  be  completely  arbitrary.  Hence,  there  exist  scalars  ap 
a?,  . ..,  in  B such  that 

x = E a.y1  ; 
j=l  J 


that  is, 
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x(k)  = I a (k)yJ'(k)  , k e Z . 

j=l  J 


From  the  definition  of  the  vectors  bj_,  b2,  bn 


we 


yJ’(k)  = l av  (k)b  (k),  a 's  e k,  k e Z and  j = 1, 
v=l  j J 


Hence 


x ( k ) 


= 2 (k)  l a (k)b  (k)  , k e Z 

j = l J v=l  vj 


n q 

l ( I <MkK,  (k))b„(k)  , 
j 


V=1  j=l  J V-!  V 


so  we  define 


sv(k)  = l a-j(k)a  (k)  for  each  k e Z 
j = l J j 


It  must  be  clear  that  for  each  v * 1,  Z n,  s e 


n 

x = l s b 
i v v 
v=l 


i .e. , 


have  that 


2,  q . 


6.  Therefore, 


x £ b2 , 


•••»  bn>B 
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But  x was  completely  arbitrary,  so  we  must  conclude 


1ml*  — <b^ , b^,  • • • , b^j^g  • 


We  have  thus  shown  that  (b-p  bp,  . ... 
B-module  Imr.  That  is,  ImT  is  a free  B-module 


bp}  is  a basis 
with  rank  N. 


EXAMPLE:  d)  Let  T e B^x^  be  defined  by 


r(k)  = 


IT  , 

sin  ^ k 


cos  2 k 


A(k) 


-cos  2 k 


IT  . 

sin  j k 


k e Z 


J 

From  example  (b)  we  see  that  rank  r(k)  = 2 for  all  k e Z.  Also, 
that  Tx(k)  = (sin  \ k;  cos  \ k)T  and  T3(k)  = (-cos  \ k;  sin  | 
B-linearly  independent.  Hence,  ImT  is  free  with  rank  two. 
Yj,y3  form  a basis  for  it. 


(A. 1.14)  THEOREM:  Let  T be  any  pxq  matrix  over  B such  that 
(A. 1.15)  rank  T(k)  = n < °°  for  all  k e Z 


Then  there  exists  a qxq  mat ri x A ovp r B whose  inverse  is  also 
with  the  following  property 


for  the 


we  know 
k)"^  are 
In  fact 


over  B 
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(A.U16)  FA  - [q;  Opx(q_n)]  , 

where  Q is  a pxn  matrix  over  B satisfying  rank  Q(k)  = n for  all 
PROOF: 

Let  k be  a fixed  integer.  r(k)  can  be  reduced  into  it 
echelon  form  by  a series  of  elementary  column  operations.  That 
can  find  a non-singular  matrix  Ak  such  that 


r(k)Ak  = [Qk 


0 , \ ] 
px(q-n) J 


Furthermore,  because  of  (A. 1.15)  Qk  is  a pxn  matrix  with  rank 
reason  why  we  use  Ak(Qk)  is  to  show  the  fact  that  for  each  k 
matrix  may  vary. 

Now,  let  us  define  a qxq  matrix,  A,  and  a qxn  matrix  Q over 
A ( k ) :=  Ak  , 

Q(iO  :=  Qk  , 

for  each  k e Z. 

It  must  be  clear  that  A and  Q satisfy  the  conditions 
theorem.  That  is 

(i ) TA  = [Q;  0qX ( p_n ) ] , 

( i i ) r"1  exi sts  over  B, 


k e Z. 

s column 
means  we 


n.  The 
such  a 

B by 


of  the 


(iii)  rank  Q(k)  = n for  each  k e Z. 


□ 
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(A. 1.17)  COROLLARY:  The  columns  of  Q (A. 1.15)  form  a basis  for  the 

B-module  Imr. 

PR00F_:  At  once,  we  see  that  Imr  = ImQ  from  relation  (A.  1.16)  and  from 

the  fact  that  A is  invertible  over  6.  Furthermore,  the  columns  of  Q are 
B-linearly  independent. 

□ 


APPENDIX  TWO 

PARTIAL  REALIZATION  PROBLEM 

In  this  section,  we  define  a more  general  realization  problem  than 
the  one  considered  in  this  project.  We  also  find  necessary  and 
sufficient  conditions  for  a linear  i/o  map  to  be  realizable  over  a 
proper  subset  of  the  causal  half  plane. 

Given  a linear  input/output  map 

(A. 2.1)  fw  : bJ  ■»  Gj  : u ■*>  fw(u)  : k ->■  E W(k,  l)u(l) 

1 =-co 

we  observe  that  f^  can  be  thought  of  as  the  input/output  description  of 

a linear  system  P with  unit-pulse  response  matrix  W(k,  1)  which  may  not 

be  finite-dimensional.  Then,  the  (i  ,j)th-entry  of  W,  ^.(k,  1) 
represent  the  response  of  P for  k > 1 at  the  ith-output  terminal  when 
in  the  jth-input  terminal  a unit  pulse  is  applied  at  time  1.  Therefore, 
it  follows  that  in  order  to  have  a complete  knowledge  of  W(«,  •)  on 

the  causal  half-plane  CP  we  must  not  only  apply  a unit  pulse  to  each 

input  terminal  at  every  1 e Z but  also  measure  the  response  of  the 
system  at  each  output  terminal  at  every  k > 1.  From  the  practical 
point  of  view  this  is  very  unrealistic  because  any  input/output 
experiment  must  have  a finite  duration. 
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From  the  above  observation,  we  have  that  the  unit-pulse  response 
matrix  W(»,  •)  of  the  response  map  will  be  defined,  or  known,  only 
on  a subset  Q of  the  causal  half-plane  CP  in  general  . Hence,  a more 
natural  definition  of  the  realization  problem  for  discrete  time-varying 
systems  is 


(A. 2. 2)  DEFINITION:  Let  f,^:  6™  * 8^  be  a linear  response  map  whose 

unit  pulse  matrix  W(»,  •)  is  known  only  on  a subset  Q of_  CP.  We 
shall  say  that  fw  is  realizable  on  Q if  there  exists  a finite- 
deimensional  system  E = (D,  E,  H)  over  8 such  that 

W ( k , 1 ) = Ws  ( k , 1 ) for  each  ( k , 1 ) e Q , 

where  Wj(k,  1)  = H(k)<t>(k,  1 + 1)E(1  +1)  is  the  unit-pulse  response 
matrix  of  E.  We  shall  also  say  that  E is  a realization  of  fw  _on_  Q. 
realization  is  said  to  be  minimal  if  there  is  no  realization  with 
smal ler  dimension. 

Given  an  input/output  map  fw  as  in  definition  (A. 2. 2),  let  us 
consider  the  response  map  f^:  B1^  > 8^  whose  unit-pulse  response  is 
defined  by 


(A. 2. 3) 


W(k,  1) 


W(k,  1)  ={ 


( k , 1 ) e Q 


0 


(k,  1)  e CP/Q 
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Then  we  have  at  once  the  following  result. 

(A. 2.4)  THEOREM:  A linear  i/o  map  f^:  B™  + B+  is  realizable  on  a 

subset  Q of  CP  if  and  only  if  the  response  map  fg:  B™  -►  B^  defined  by 
(A. 2. 3)  is  realizable  on  CP. 

PROOF : Sufficiency  follows  directly  from  definition  (A. 2. 2)  and  from 

(A. 2. 3).  Hence  necessity  only  needs  being  shown.  So,  assume  that  fw  is 
realizable  on  Q,  then  by  definition  there  exists  a finite-dimensional 
system  E = (D,  E,  H)  such  that 

W(k,  1)  = H( k ) <t>s ( k , 1+1)E(1+1)  for  all  (k,  1)  e Q 

Define  the  following  subsets  of  Z: 

Q.  :=  {k  e Z:  (k,  1 ) e Q,  for  some  1 e 1}  , 

Q 2 :=  d E (k,  1)  e Q,  for  some  k e Z} 

Let  E = (IT,  F,  TT)  be  a discrete  time-varying  system  given  by 


(A. 2. 5)  IT  = 0 . 
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(A. 2.6)  F(k)=< 


E(k),  for  each  k such  that  k-1  e Q, 


0 , otherwise 


(A. 2.7) 


H(k) 


TT(k)  = < 


k e ; 


otherwise 


From  (2.3.6),  we  know  that  the  unit-pulse  response  matrix 
£ is  given  by 

(A. 2. 8)  Wg(k,  1)  = H( k ) ( k , 1+1)E(1+1)  for  each  (k,  1 

Now,  because  of  (A. 2. 5)  we  may  write  (A. 2. 8)  as 

(A. 2. 9)  W-(k,  1)  = ¥(k)os(k,  UrO+1)  , (k , 1 ) e CP 

Suppose  (k,  1)  e Q,  then  we  have  that  k £ Q1  and  1 £ 
from  (A. 2. 6)  and  (A. 2. 7)  we  obtain 

W-(k,  1)  = H ( k ) 4>  ( k , 1+1)E(1+1) 


WgC - , •)  of 


£ CP 


Therefore , 


= W(k,  1)  (by  assumption) 


172 


On  the  other  hand,  if  (k,  1)  £ q,  then  either  k £ or  1 £ q . 
Assume  that  k £ Q^,  in  that  case  TT( k ) =0  by  definition.  When 

1 £ Q2>  from  (A. 2. 6)  it  is  seen  that  1(1+1)  = 0.  Hence,  we  may 
conclude  from  (A. 2. 9)  tnat 

W-(k,  1)  = 0 for  each  (k,  1)  £ Q 

l 

In  resume,  we  have  shown  that 


¥k» 


W(k,  1) 


1)  = \ 


(k,  1)  e Q 


otherwi se 


i.e.,  £ is  a realization  of  f-j  on  CP. 

w 

□ 

(A. 2. 10)  COROLLARY:  Let  E = (0,  E,  H)  be  a minimal  realization  of  f^ 

on  Q,  and  let  £ = (D,  E,  H)  be  a minimal  realization  of  f—  on  CP. 

w — 

Then 


dim  E = dim  E 


PROOF : It  follows  directly  from  the  proof  above. 

Let  kg  be  a fixed  integer  and  let  Q be  defined  by 


□ 
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(A. 2. 11)  Q :=  { (k,  1)  e ZxZ  : k > 1 > kQ}  . 

Note  that  Q is  a proper  subset  of  the  causal  half-plane. 

Any  response  map  f^:  8™  ->  Bp  whose  unit-pulse  response  W(»,  •) 
is  known  only  on  Q (defined  in  (A. 2. 11))  may  represent  the  i/o  data  of  a 
physical  system  P which  underwent  an  input/output  experiment  at  time 

k = I<q.  For  this  case,  the  question  of  realizability  is  answered  by  the 
following. 


(A.2.12)  THEOREM:  Let  f^:  B™  * Bp  be  a linear  i/o  map  with  unit 

pulse  response  W(»,  •)  defined  only  on  Q given  by  (A. 2. 11).  f^  is 

realizable  on  Q if  and  only  if  there  exists  a finite-positive  integer  n 
such  that  for  each  k > kQ 


(A. 2. 13)  rank 


W(k,  k-1) 

W(k+l,k-l) 

W(k+2,k-l) 


W(k , k-2) 
W(k+l,k-2) 
W(k+l,k-2) 


W(k,  k0) 

w(k+i,K0) 

W(k+2,kQ) 


< n. 


Furthermore,  the  smallest  positive  integer  n for  which  (A. 2. 13)  holds  is 
the  dimension  of  a minimal  realization. 


PR0QF:  8y  theorem  (A. 2. 4)  f , is  realizable  on  Q if  and  only  if  f- 

see  (A. 2. 3)  is  realizable  on  CP.  But  from  theorem  (3.2.1b)  f-  is 

w 

realizable  iff  there  exists  a finite  positive  integer  n such  that 
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(A. 2. 14)  rank  B^(k)  < n for  al 1 k zl 
Recall  that 


where 

W’ij(k)  :=  W(k+i-l,  k-j) 


Therefore,  by  using  the  fact  that 


W(k,  1)  , k > l > k 


W(k,  1)  = < 


0 


0 , otherwise 


it  is  not  hard  to  see  that 


(A. 2. 15)  Mk)  = 


W(k,k-1) 

w(k+i,k-i) 

W(k+2,k-i) 


W(k,k-2) 

W(k+l,k-2) 

W(k+2,k-2) 


for  each  k e (kQ+l,  k(J+2, 


e Z+,  k £ Z . 


W(k,lQ)  0 0 ... 

w(k+i,k0)  0 o ... 

W(k+2,kfJ)  0 0 ... 


J 
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But,  it  must  be  clear  that  rank[A(k)  ; 0]  = rank  A(k)  for  each 

k e Z,  so  from  (A. 2. 14)  and  (A. 2. 15)  the  first  part  of  the  theorem 

* 

follows  automatically.  The  last  part  to  be  shown  is  a direct 
consequence  of  theorem  (3.2.15)  and  corollary  (A. 2. 10.). 

□ 

The  result  of  theorem  (A. 2. 12)  has  been  proved  to  be  useful  in 
deciding  when  the  matrix  covariance  sequence  Rk  1 associated  with  some 
(m-vector)  random  process  {yt)“=0  is  semi  separable  (see  SCHWARTZ, 

DICKINSON  and  SONTAG  [1983]  for  details). 

The  "dual"  of  theorem  (A. 2. 12)  is  the  following. 


(A. 2. 16)  THEOREM:  A linear  i/o  map  f,y.  B™  •*  8^  with  unit  pulse 

response  W(»,  •)  defined  only  on  the  set  Q = { ( k , 1)  i ZxZ  : 

k o > k > 1 , kg  = fixed  integer}  is  realizable  (on  Q)  if  and  only  if 
there  exists  a finite  positive  integer  n such  that  for  each  k < k 


(A. 2. 16)  rank 


W(k,k-1) 

W(k+l,k-l) 

• 

W(kg-l,k-l) 

W(kQ,k-l) 


W(k,k-2) 

W(k+l,k-2) 

W(ku-l,k-2) 

W(k0,k-2) 


W(k ,k-3) 
W(k+l,k-3) 


M(k0-l,k-3) 

W(kg,k-3) 


< n 
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Furthermore,  the  smallest  positive  integer  n for  which  (A. 2. 16)  holds 
is  the  dimension  of  a minimal  realization. 

PROOF : Use  duality  in  the  proof  of  theorem  (A. 2. 12). 

□ 

Unfortunately,  the  kind  of  input/output  maps  considered  in  theorems 
(A. 2. 12)  and  (A. 2. 15)  cannot  have  finite  constant  rank  (even  in  the  case 
when  they  are  realizable).  Therefore,  the  algorithm  developed  in  this 
work  can  not  be  applied  to  find  canonical  realizations  of  those  i/o 
maps . 
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